-- Logs begin at Tue 2022-02-15 03:38:28 UTC, end at Tue 2022-02-15 04:45:10 UTC. -- Feb 15 04:05:39.357347 dv-cinder-816104-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 15 04:05:39.366912 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Feb 15 04:05:39 2022] *** Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: nodename: dv-cinder-816104-2-iscsi Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: machine: x86_64 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: clock source: unix Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: pcre jit disabled Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: detected number of CPU cores: 4 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: current working directory: / Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: detected binary path: /usr/bin/uwsgi-core Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: your processes number limit is 47680 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: your memory page size is 4096 bytes Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: detected max file descriptor number: 2048 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: lock engine: pthread robust mutexes Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: thunder lock: enabled Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 15 04:05:39.372932 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 15 04:05:39.433345 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: Python main interpreter initialized at 0x55aaa4cc99c0 Feb 15 04:05:39.433345 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: python threads support enabled Feb 15 04:05:39.433345 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: your server socket listen backlog is limited to 100 connections Feb 15 04:05:39.433345 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: your mercy for graceful operations on workers is 90 seconds Feb 15 04:05:39.433924 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: mapped 403077 bytes (393 KB) for 2 cores Feb 15 04:05:39.434059 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: *** Operational MODE: preforking *** Feb 15 04:05:39.434374 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: *** uWSGI is running in multiple interpreter mode *** Feb 15 04:05:39.434374 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: spawned uWSGI master process (pid: 79207) Feb 15 04:05:39.434642 dv-cinder-816104-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 15 04:05:39.435519 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: spawned uWSGI worker 1 (pid: 79225, cores: 1) Feb 15 04:05:39.436034 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: spawned uWSGI worker 2 (pid: 79226, cores: 1) Feb 15 04:05:39.436350 dv-cinder-816104-2-iscsi devstack@keystone.service[79207]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 15 04:05:45.469554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:05:45.469554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: from cryptography.utils import int_from_bytes Feb 15 04:05:45.470374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:05:45.470374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: from cryptography.utils import int_from_bytes Feb 15 04:05:45.517618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:05:45.517806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:05:45.517991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] command line args: [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:05:45.518261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:05:45.518455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ================================================================================ {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:05:45.518698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] admin_token = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.518949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] config_dir = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.519138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.519321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] config_source = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.519503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] debug = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.520205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.521987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_config_append = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.522157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.522335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_dir = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.522517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_file = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.522756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.523006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.523254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.523502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.523681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.523857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.524102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.524348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.524581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.524816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.525076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.525311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.525558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.525804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.526084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.526580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.526764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] publish_errors = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.527000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.527229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.527408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.527654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.527889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.528123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] standard_threads = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.528357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.528601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.528777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.528982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] use_journal = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.529159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] use_json = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.529334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] use_stderr = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.529507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] use_syslog = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.529738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:45.529997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.530238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.530501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.530741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.530997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.531236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.531484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.531721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.531969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.532218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.532471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.532709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.532989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.533231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.533480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.533728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.533966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.534223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.534479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.534725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.534962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.535216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.536028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.536499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.536996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.537193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.537432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.537669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.537906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.538154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.538406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.538641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.538874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.539124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.539372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.539609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.539858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.540091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.540326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.540563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.540794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.541052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.541286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.541519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.541756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.542005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.542237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.542475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.542704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.542941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.543178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.543425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.543657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.543894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.544130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.544365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.544603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.544839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.545098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.545349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.545585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.545834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.546065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.546326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.546563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.546792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.547027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.547261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.547530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.547769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.548015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.548262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.548498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.548734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.548995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.549248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.549487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.549721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.549962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.550199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.550438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.550671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.550931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.552214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.552541 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.552795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.553073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.553332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.553583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.553827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.554070 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.554311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.554548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.554782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.555014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.555253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.555485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.555725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.555963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.556215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.556454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.556711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.556996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.557241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.557473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.external = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.557705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.558002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.558235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.558472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.password = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.558708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] auth.token = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.558949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.559187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.559434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.559665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.559911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.560158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.560391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.560628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.560881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.561155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.561404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.561643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.561886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.562120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.562380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.562636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.562880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.563135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.563420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.563667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.563931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.564171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.564426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.564662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.564918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.565169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.565415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.565647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.565894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.566129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.566382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.567174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.567543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.567968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.568305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.568551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.568806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.569095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.569338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.569740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.569879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.570042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.570281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.570693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.570832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.571010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.571304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.571537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.571783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.572031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.572279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.572536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.572785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.573083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.573322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.573558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.573792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.574028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.574267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.574504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.574748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.574989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.575238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.575470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.575716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.575964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.576199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.576445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.576692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.576944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.577185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.577417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.577655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.577891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.578136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.578371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.578607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.578855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.579101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.579334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.579565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.579812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.580058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.580294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.580529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.580763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.581021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.581265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.581523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.581756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.582008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.582340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.582726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.583003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.583240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.583529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.583766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.584008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.584237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.584487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.584734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.585012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.585255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.585501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.585732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.585979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.586218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.586457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.586691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.586925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.587171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.587428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.587665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.587920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.588152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.588398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.588647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.588878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.589137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.589385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.589626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.589870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.590110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.590352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.590604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.590857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.591095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.591343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.591593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.591830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.592076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.592312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.592551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.592787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] role.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.593059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] role.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.593292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.593542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.593789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.594037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.594282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.594533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.594779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.595026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.595272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.595516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.595745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.595993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.596239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.596485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.596932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.597173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.597425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.597676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.597968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.598435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.598727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.598987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.599242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.599484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.599720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.599954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.600188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.600439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.600697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.600978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.601231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.601471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.601705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.601945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.602185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.602437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.602674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.602930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.603179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.603421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.603666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.603907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.604156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.604394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.604634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.604870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.605141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.605390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.605621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.605865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.606169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.606432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.connection = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.606676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.606927 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.607165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.607408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.607645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.607877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.608112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.608348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.608593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.608828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.609095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.609331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.609581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.609810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.610063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.610293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.610535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.610769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:45.610943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79225) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:05:45.643665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.643893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.644120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.653447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.684757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.685199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.745855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.800713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.801007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.873660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.873859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.874085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.874303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.874521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.874736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.899288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.899521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.899746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.899966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.900185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.900399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.900613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.912712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.925308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.925537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.925758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.926093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.926454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.926843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.927093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79225) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:45.945261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.945470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 15 04:05:45.945808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.946010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 15 04:05:45.946278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.946537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.946793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.947045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.958852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.959131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.959400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.959679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.967885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:45.971136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:45.971406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.971685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.971967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.972301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.972502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.972769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.973596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.974030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.974537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:45.974820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.001794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.003426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.003698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.009351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.009768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.010047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.017486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.017767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.023175 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.023475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.023757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.024027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.024296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.024565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.024833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.025126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.044423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.044708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.049251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.053342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.053762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.059037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.062711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.066344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.066819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.067112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.067398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.067673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.067949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.088316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.088632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.088938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.089205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.097041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.099666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.099941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.104564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.104842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.105148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.105428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.105724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.119404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.119688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.120046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.120353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.157106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:05:46.157106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: from cryptography.utils import int_from_bytes Feb 15 04:05:46.157767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 15 04:05:46.157767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: from cryptography.utils import int_from_bytes Feb 15 04:05:46.203573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 15 04:05:46.203771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 15 04:05:46.203943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] command line args: [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 15 04:05:46.204227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 15 04:05:46.204407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ================================================================================ {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 15 04:05:46.204664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] admin_token = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.204934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] config_dir = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.205131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.205316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] config_source = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.205495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] debug = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.205712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.205952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.206131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.206383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.206633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.206862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.207040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_config_append = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_dir = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_file = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.208859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.209141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.209321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.209497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.209742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.209985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.210219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.210458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.210690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.210921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.211170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.211422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.211706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.212250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.45/identity {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.212433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] publish_errors = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.212671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.212921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.213108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.213359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.213597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.213836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] standard_threads = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.214069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.214314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.214496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.214670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] use_journal = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.214847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] use_json = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.215022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] use_stderr = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.215203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] use_syslog = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.215432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 15 04:05:46.215692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.215932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.216194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.216434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.216684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.216941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.217197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.217437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.217686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.217935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.218190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.218432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.218675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.218913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.219158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.219407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.219646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.219804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.219891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.220142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.220304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.220384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.220457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.220612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.220864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.221156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.221411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.221668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.221896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.222126 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.222407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.222598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.223507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.223773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.224089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.224228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.224488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.224844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.225113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.225365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.225603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.225840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.226079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.226312 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.226542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.226772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.227004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.227242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.227490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.227722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.227960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.228189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.228425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.228659 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.228920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.229156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.229395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.229633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.229869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.230104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.230340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.230570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.230818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.231054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.231292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.231522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.231782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.232017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.232255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.232490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.232723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.233013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.233254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.233507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.233751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.233989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.234225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.234463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.234709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.234950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.235185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.235426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.235663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.235903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.236138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.236373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.236609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.236872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.237137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.237377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.237613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.237854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.238092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.238329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.238744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.239049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.239281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.239499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.239594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.239742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.240126 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.240376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.240620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.240877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.241142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.241404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.241669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.241915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.242150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.external = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.242391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.242692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.242775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.242930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.243165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.password = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.243402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] auth.token = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.243640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.243879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.244128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.244360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.244609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.244856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.246189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.246814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.247076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.247334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.247588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.247753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.247843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.248069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.248322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.248558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.248827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.249107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.249359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.249442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.249616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.249703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.249905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.249995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.250155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.250423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.250669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.250925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.251161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.251399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.251648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.251896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.252126 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.252411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.252650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.252938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.253164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.253420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.253663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.253911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.254191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.254443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.254693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.254931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.255166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.255416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.255647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.255886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.256134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.256385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.256618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.256850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.257205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.257422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.257507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.257822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.258133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.258449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.258766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.259122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.259278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.259418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.259705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.259987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.260274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.260553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.260838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.261108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.261605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.261856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.262090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.262339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.262640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.262804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.262890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.263090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.263180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.263352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.263431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.263585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.263665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.263823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.264054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.264291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.264529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.264773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.265036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.265287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.265540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.265789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.266023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.266256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.266507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.266754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.266992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.267229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.267464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.267695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.267937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.268197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.268430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.268675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.268939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.269191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.269427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.270388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.270528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.270676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.271018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.271259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.271511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.271760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.272008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.272255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.272504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.272734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.273004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.273245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.273372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.273487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.273657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.273738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.273947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.274037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.274187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.274435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.274671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.274926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.275157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.275401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.275636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.275870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.276105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.276350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.276594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.276824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.277086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.277327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.277578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.277825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.278062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.278313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.278566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.278803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.279051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.279287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.279526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.279761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] role.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.280008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] role.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.280246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.280493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.280741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.281012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.281260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.281506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.281753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.281833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79225) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.282000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.282081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.282248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.282330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.282482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.282567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.282728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.282818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.282976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.283057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.283229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.283334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.283476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.283597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.283872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.283976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.284130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.284212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.284380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.284463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.284630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.284710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.284880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.284989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.285156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.285239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79225) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.285523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.285819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.286075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.286320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.286552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.286784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.287018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.287271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.287530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.287779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.288019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.288257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.288488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.288740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.288987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.289238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.289474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.289731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.289978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.290217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.290465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.290707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.290955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.291193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.291432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.291667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.291915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.292163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.292393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.292635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.292960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.293225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.connection = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.293471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.293719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.293956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.294200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.294437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.294674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.294909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.295144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.295392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.295629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.295871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.296107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.296354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.296589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.296833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.297089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.297333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.297566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 15 04:05:46.297737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79226) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 15 04:05:46.324066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.324251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55aaa4cc99c0 pid: 79225 (default app) Feb 15 04:05:46.324362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.324513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.327718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f444-eb1a-45d8-a345-419e395ef2bb None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:46.328007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f444-eb1a-45d8-a345-419e395ef2bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:46.328280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f444-eb1a-45d8-a345-419e395ef2bb None None] PATH_INFO: `/v3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:46.333287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 791 bytes} [Tue Feb 15 04:05:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:05:46.334029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.353280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.353515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.393672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.431357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.431600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.478723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.478883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.479094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.479313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.479531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.479746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.493287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.493518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.493744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.493966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.494181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.494393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.494607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.502461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.506018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.506245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.506641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.506865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.507082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.507295 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.507506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79226) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 15 04:05:46.517990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.518199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 15 04:05:46.518545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.518744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 15 04:05:46.519016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.519277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.519546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.520615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.531811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.532089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.532355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.532648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.540974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.544226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.544501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.544783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.545090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.545386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.545639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.545900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.546163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.546424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.546704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.546965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.573667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.575245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.575529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.580670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.580966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.581246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.589305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.589583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.594190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.594473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.594750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.595026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.595292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.595565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.595825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.596093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.616881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.617173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.621654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.625210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.625500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.631213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.634727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.638539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.638827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.639104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.639381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.639662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.639940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.659440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.659716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.659979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.660238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.667995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.669639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.669913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.672999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.673292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.673562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.673839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.674125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.687183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.687462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.687739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.688014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.688287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.688556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.688825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.707291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.711038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.714302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.715853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.717621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.717894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.718170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.725348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.726971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.730178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.730416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.730696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.730968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.740521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.740803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.741101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.748797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79226) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 15 04:05:46.749100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.749371 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.749636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.750056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.750220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.750449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.755892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79226) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 15 04:05:46.791041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55aaa4cc99c0 pid: 79226 (default app) Feb 15 04:05:54.616616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:54.617210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:54.617343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:54.619850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:05:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:05:54.630229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:54.630763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:54.630847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:54.760621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG oslo_db.sqlalchemy.engines [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79226) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:05:54.951413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG passlib.handlers.bcrypt [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79226) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 15 04:05:54.951833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG passlib.handlers.bcrypt [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79226) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 15 04:05:55.008232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:05:55.009878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:05:55.133433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1/3] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:05:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:05:55.171721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:05:55.204437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG oslo_db.sqlalchemy.engines [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79225) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 15 04:05:55.339499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b7534-8afd-4df6-afab-bb740121bbc4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:05:55.343838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:05:55.344511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:55.344794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:55.345100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:55.354032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:05:55.408573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.common.rbac_enforcer.enforcer [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 15 04:05:55.408930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efb223-c5d6-42c0-ba1d-b4ddaa2185ff admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:05:55.422479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 3/4] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:05:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:05:55.429084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:05:55.443441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc631e-7afe-4202-b70b-a768103d5413 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:05:55.447837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:05:55.448978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:55.449266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:55.449545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] PATH_INFO: `/v3/projects/14db3a76771b4984aca50bf3056efc27` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:55.451185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] RBAC: Authorizing `identity:get_project(project_id=14db3a76771b4984aca50bf3056efc27)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:05:55.503300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.common.rbac_enforcer.enforcer [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 15 04:05:55.503567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d96cc2-cbd9-4565-b1b9-03b8a79a777a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:05:55.508450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 2/5] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:05:55 2022] GET /identity/v3/projects/14db3a76771b4984aca50bf3056efc27 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:05:57.736007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec7cd-3c84-43d4-910c-5cd7768e7487 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:57.736539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec7cd-3c84-43d4-910c-5cd7768e7487 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:57.736539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec7cd-3c84-43d4-910c-5cd7768e7487 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:57.741163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 4/6] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:05:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:05:57.746879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:57.747361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:57.747564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:57.767896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:05:57.770214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:05:57.778439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 3/7] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:05:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:05:57.801055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec7cd-3c84-43d4-910c-5cd7768e7487 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:05:57.817428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec7cd-3c84-43d4-910c-5cd7768e7487 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:05:57.821809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:05:57.822465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:57.822755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:57.823035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:57.831374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:05:57.833890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38c1e5-985f-4466-b434-328f2b3ace3d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:05:57.843263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 5/8] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:05:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:05:57.849041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:05:57.858189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ade2f6-a386-42a5-b90d-5d2606d5d27f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:05:57.862559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:05:57.863488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:05:57.863771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:05:57.864050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:05:57.865479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:05:57.867328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc4e8f-a594-41a2-813c-d073d63d5fa7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:05:57.868917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 4/9] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:05:57 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:00.216821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e72be-4550-481d-a0dc-20625f1a62df None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.217377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e72be-4550-481d-a0dc-20625f1a62df None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.217477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e72be-4550-481d-a0dc-20625f1a62df None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.219145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:00.226689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.227209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.227496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.233828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024dbc-e9e4-43db-9b67-a3b3972447a2 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.234106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024dbc-e9e4-43db-9b67-a3b3972447a2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.234383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024dbc-e9e4-43db-9b67-a3b3972447a2 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.236174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 7/11] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:00.243334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.243621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.243898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.250253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:00.251512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:00.259576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 5/12] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:00.284170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.292118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG passlib.handlers.bcrypt [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79225) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 15 04:06:00.292532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG passlib.handlers.bcrypt [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79225) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 15 04:06:00.293876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd146fdf-d6eb-4f5c-a216-9754818297b2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.298574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.299369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.299653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.299930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.314497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:00.321989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:00.323233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 6/13] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:00.334123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.341080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:00.342733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:00.345980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7ebdf-3b10-48ac-8b5e-6b5c356c04ec admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.351525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.352197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.352485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.352768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.353655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:00.355027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.355700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:00.355700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:00.355700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:00.356606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.367723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 8/14] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:00.371399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 7/15] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:00.377006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.392433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2707b-fa87-4cc5-a2f2-49ed98c8ca34 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.394302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.399250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.400490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.400783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.401108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.402770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.404674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.404831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ab0ba-4ca9-47f9-af4d-688d274df444 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.406350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 9/16] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:00.412245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.412615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.413127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.413493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.413852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.422702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.423671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1466c1c-9f6b-45f2-a679-ad727fef5482 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.424498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.429722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.430972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.431435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.431884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.433947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.437059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.439073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 8/17] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:00.439967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 10/18] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:00.446324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.448667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:00.456172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45ea91-f11c-4913-891a-4f3c9dc8d936 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.459139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76035e5-5655-4439-90bc-78f0c97face8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:00.461845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.462647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.462916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.463192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.464291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:00.464445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.465098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:00.465415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:00.465750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:00.466184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1168e4-768d-4d73-960a-98f4bc6caf68 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.466733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.domain.id=default, user.id=15fad1a67004416983756cf42a1eae2d) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:00.467155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:00.467787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 9/19] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:00.469815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:00.469815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:00.469815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:00.472101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779f83-c3d6-4c0e-b760-3900d89b006e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:00.489518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 11/20] 10.222.0.45 () {56 vars in 1343 bytes} [Tue Feb 15 04:06:00 2022] GET /identity/v3/role_assignments?user.id=15fad1a67004416983756cf42a1eae2d&scope.domain.id=default&role.id=3e51986d5b3b4564805a85330713b776 => generated 233 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:03.985176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b67e-f580-4039-acc1-8935154a8b4e None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:03.985927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b67e-f580-4039-acc1-8935154a8b4e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:03.985927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255b67e-f580-4039-acc1-8935154a8b4e None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:03.987959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:03.995113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd067c-c77b-4f5e-8dd2-b37884c2f6ff None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:03.996169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd067c-c77b-4f5e-8dd2-b37884c2f6ff None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:03.996169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd067c-c77b-4f5e-8dd2-b37884c2f6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.029661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-32cd067c-c77b-4f5e-8dd2-b37884c2f6ff None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:04.030985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-32cd067c-c77b-4f5e-8dd2-b37884c2f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:04.040589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 12/22] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:04.089130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b67e-f580-4039-acc1-8935154a8b4e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.123017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255b67e-f580-4039-acc1-8935154a8b4e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.132391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.133742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.134215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.134686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.152147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef8ca-8e0d-4de4-b7fd-021a7fe8291c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.153231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef8ca-8e0d-4de4-b7fd-021a7fe8291c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.154033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ef8ca-8e0d-4de4-b7fd-021a7fe8291c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.158244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 13/23] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:04.168011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.169259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.170096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.170388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:04.184416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:04.192017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 11/24] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:04.198031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.218389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bab380-d37e-43da-b9c0-2985f7abbde7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.226779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:04.229400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:04.234564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.235322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.235530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.235968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.236879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:04.237345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:04.239799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:04.257584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 12/25] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:04.263563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.265697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:04.282438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22209057-a2f4-4721-838c-1670c3311e22 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.297780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.298765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.299022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.299268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.300624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:04.301573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.302607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:04.304772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 13/27] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:04 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:04.314277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.328935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c9e64-2441-4e4b-9d94-2fb7db6589ab admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.333783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76920d-84b7-4d4c-91d0-0e7ad288a2bb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.349104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.349945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.350233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.350512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.351913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:04.353721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:04.355785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 14/28] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:04.357332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.358946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.359837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.360745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.361398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:04.363558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:04.366010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:04.366010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:04.366010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:04.368677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfb4d5-0f77-4620-beb8-c7542fa409e9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:04.380959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02b896-a36e-4048-8289-20b21e3c0446 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:04.401869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:04.402770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.403059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.403327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] PATH_INFO: `/v3/domains/default/users/15fad1a67004416983756cf42a1eae2d/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.405810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=15fad1a67004416983756cf42a1eae2d, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:04.407073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:04.407073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:04.407073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:04.409586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae2c56-00b9-4bb5-992c-7ae31e801da0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:04.580737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1382 bytes} [Tue Feb 15 04:06:04 2022] PUT /identity/v3/domains/default/users/15fad1a67004416983756cf42a1eae2d/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:04.664164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 15/30] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:06:04 2022] POST /identity/v3/roles => generated 225 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:04.825812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76eb93-02a6-41aa-86b2-c16cd6fba8f3 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.826539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76eb93-02a6-41aa-86b2-c16cd6fba8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.827038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76eb93-02a6-41aa-86b2-c16cd6fba8f3 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.836651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 16/31] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:04.847041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:04.848097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:04.848575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:04.906258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:04.907967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:05.035859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 16/32] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:05.098031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76eb93-02a6-41aa-86b2-c16cd6fba8f3 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.129311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76eb93-02a6-41aa-86b2-c16cd6fba8f3 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.140274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.142128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.142912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.143664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.167736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.172101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.209489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:06:05.212538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 17/33] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:05.218227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.237297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c0ae4-b28c-4f4b-905d-7cc66bf5847c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.242223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.242914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.243203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.243488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.244254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:05.244566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.245832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:05.245832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:05.245832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:05.246766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d00d2d-6e2e-4553-b1ea-33cfcc95f908 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.286245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 17/34] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:05.293006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.324679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc4bf3-61d9-494f-836c-69b8aecab2cd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.339792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.341515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.342386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.343159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.344928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.347895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:05.347895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:05.347895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:05.351367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47cf23-6022-4b1d-8082-619ec87e4367 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.432194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 18/35] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/projects => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:05.565908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588b0d-3a03-42b1-ae00-5a3afc625379 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.567143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588b0d-3a03-42b1-ae00-5a3afc625379 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.567657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79588b0d-3a03-42b1-ae00-5a3afc625379 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.570187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:05.578732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892d012-d30b-432c-bee5-c16a2340cf67 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.579240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892d012-d30b-432c-bee5-c16a2340cf67 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.579742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6892d012-d30b-432c-bee5-c16a2340cf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.622920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6892d012-d30b-432c-bee5-c16a2340cf67 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:05.626006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6892d012-d30b-432c-bee5-c16a2340cf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:05.630419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fd51-b6e8-46e9-89b8-8994a4925a61 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.630985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fd51-b6e8-46e9-89b8-8994a4925a61 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.631467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2fd51-b6e8-46e9-89b8-8994a4925a61 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.641628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 19/37] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:05.648436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.649043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.649528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.699997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:05.701612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:05.760555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:05.785567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d76ef-54ce-4306-8d2e-ede4c403820c None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.786333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d76ef-54ce-4306-8d2e-ede4c403820c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.786975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d76ef-54ce-4306-8d2e-ede4c403820c None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.791368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 20/39] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:05.799175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.799992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.801238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.832677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:05.832677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:05.843382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:05.844349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.852124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:05.867648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5e468-c518-45db-abb8-bd52d853c18f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.873820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.874496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.874793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.875080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.876034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.877226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:05.877226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:05.877226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:05.878249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.882439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.896197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced34192-5a82-423a-81df-0f5f5f2d6617 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.898590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/roles => generated 219 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:05.899469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.902090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.903128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.903628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.904165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.905235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.907216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7be1f-b5b9-40ce-8f2f-6322591cb796 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.910977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4467d28-3588-4504-9ea9-bb3cbf5840d4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.916916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.917817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.918070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.918353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.919895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.921838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:05.924025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 23/43] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:05.929376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 21/44] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/roles => generated 223 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:05.930217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:05.947192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3a34-e509-4b1b-8782-b55075875db8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:05.954202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:05.955259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:05.955726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:05.956277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:05.958085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:05.960715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0e15c-466c-47fd-bc6d-fa49e9fb6812 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:06.002917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 24/45] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:06:05 2022] POST /identity/v3/projects => generated 312 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:07.515264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed3f1-b4dc-4bbf-87c8-4c1eb5e4b2dc None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.515799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed3f1-b4dc-4bbf-87c8-4c1eb5e4b2dc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.515930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fed3f1-b4dc-4bbf-87c8-4c1eb5e4b2dc None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.517808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 22/46] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:07.524012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.524544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.524754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.545156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:07.546387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:07.609944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 25/47] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:07.635108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fed3f1-b4dc-4bbf-87c8-4c1eb5e4b2dc None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:07.650267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fed3f1-b4dc-4bbf-87c8-4c1eb5e4b2dc None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:07.654668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:07.655466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.655754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.656034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.674397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:07.682293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:07.683854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 23/48] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:07.689578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:07.699309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90523bec-5fe9-4099-9220-7dca5b42ce68 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:07.703732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:07.704393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.704678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.704994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.705761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:07.706078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:07.707738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:07.716406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 26/49] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:07.721924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:07.732194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078118-982d-4036-9deb-aee8a2356876 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:07.736593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:07.737491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.737778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.738670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.739911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:07.741789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:07.743540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 24/50] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:07 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:07.748778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:07.758951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614345d3-9e2a-48bc-9b57-aa11008e06b7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:07.763748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:07.764531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.764818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.765128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.766368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:07.768132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6126b-6abf-4a07-acfc-4b4811c8c8b1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:07.770448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 27/51] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:07.776139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:07.786700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0d68-8aad-4854-8b6b-0e974de84341 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:07.791141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:07.791795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:07.792081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:07.792361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:07.793240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.domain.id=default, user.id=15fad1a67004416983756cf42a1eae2d) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:07.793555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:07.795434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21e4c8c-70fd-4ca8-aecd-f394369efb89 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:07.801456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 25/52] 10.222.0.45 () {56 vars in 1343 bytes} [Tue Feb 15 04:06:07 2022] GET /identity/v3/role_assignments?user.id=15fad1a67004416983756cf42a1eae2d&scope.domain.id=default&role.id=3e51986d5b3b4564805a85330713b776 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:08.376382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5253-cc58-4c58-b5b6-86e8e66ad3f8 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:08.376675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5253-cc58-4c58-b5b6-86e8e66ad3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:08.376994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5253-cc58-4c58-b5b6-86e8e66ad3f8 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:08.379283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 28/53] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:08.385237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:08.385514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:08.385794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:08.405476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:08.406710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:08.414480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 26/54] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:08.439352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd5253-cc58-4c58-b5b6-86e8e66ad3f8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:08.452258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd5253-cc58-4c58-b5b6-86e8e66ad3f8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:08.456747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:08.458117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:08.458404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:08.458687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:08.459927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:08.461684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f9294-e712-4453-b438-8f94132e9f33 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:08.463315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 29/55] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:08.469106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:08.478212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d20e7-64f8-4a8d-950c-5656fb632587 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:08.482702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:08.483365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:08.483656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:08.483945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:08.484668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:08.485791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:08.485791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:08.485791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:08.487026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6348c0-0f9f-4ab9-a8b9-082e5ef3180e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:08.518550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 27/56] 10.222.0.45 () {60 vars in 1161 bytes} [Tue Feb 15 04:06:08 2022] POST /identity/v3/projects => generated 298 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:10.776927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822e53-563c-4be5-a58a-950edc83be55 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:10.777459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822e53-563c-4be5-a58a-950edc83be55 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:10.777542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad822e53-563c-4be5-a58a-950edc83be55 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:10.779338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 30/57] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:10.786057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:10.786745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:10.786745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:10.807179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:10.808402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:10.870421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 28/58] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:10.896007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822e53-563c-4be5-a58a-950edc83be55 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:10.908298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad822e53-563c-4be5-a58a-950edc83be55 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:10.913756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:10.914539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:10.914827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:10.915104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:10.916301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:10.918047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab5c4d-38e0-414d-8957-53e7361d880c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:10.919626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 31/59] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:10.925121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:10.934852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9ed66-3898-49b7-930a-bd061396a9bb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:10.939265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:10.939926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:10.940210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:10.940481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:10.941781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:10.942800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:10.942800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:10.942800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:10.944052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e73b8b-5e43-47b0-b982-c40a9dd5e4b2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:10.970756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 29/60] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:10 2022] POST /identity/v3/users => generated 275 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:15.412610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230bf2-ae17-429e-86d2-15b1eb5b3c81 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.414435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230bf2-ae17-429e-86d2-15b1eb5b3c81 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.415276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f230bf2-ae17-429e-86d2-15b1eb5b3c81 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.419541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 32/61] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:15.429885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.431537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.432351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.478894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:15.481467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:15.504557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 30/62] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:15.580426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230bf2-ae17-429e-86d2-15b1eb5b3c81 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:15.610797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f230bf2-ae17-429e-86d2-15b1eb5b3c81 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:15.625306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:15.627159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.627974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.629340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.658905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:15.681251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:15.684414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 33/63] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:15.694730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:15.727454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f854c0-39dc-470c-91f4-d7bc2a418a9c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:15.743124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:15.744812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.745639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.746439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.760979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:15.762474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:15.765214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:15.765214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:15.765214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:15.767872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:15.804026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 31/64] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:15.813503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:15.841434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d6bef-a537-4a88-9e32-e1611f3c34c4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:15.857385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:15.858913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.859406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.859912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.902283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:15.906667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae38870-0720-441e-8d2c-317d011d1265 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:15.911027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 34/65] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:15 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:15.919508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:15.939816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296e27-59fd-4aa6-94d2-13546567bb4a None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.940204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296e27-59fd-4aa6-94d2-13546567bb4a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.940692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296e27-59fd-4aa6-94d2-13546567bb4a None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.943974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712198a3-e000-47f9-be57-f3d8a4470c19 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:15.944700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 35/66] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:15.953179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:15.953858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.954145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.954427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.955203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:15.955680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:15.956165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:15.964141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:15.966140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:15.977761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 32/67] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:15.986070 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.004025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368bd94-8b46-43dd-999c-dffe068b7b1b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.011332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:16.013272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:16.025155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.026626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.027121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.027602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.030501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.034920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.038439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 33/68] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:15 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:16.047822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 36/69] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:16.049322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.072652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.084171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db01-3793-431b-a10b-52f0e9a9063c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.091263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779af56a-a301-4db2-b427-1c55e956de1c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.101628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.103880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.105265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.106942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.108222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.109940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.112051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.113435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.114118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.114303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.117822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81f6cf-3032-4a49-b41e-ededf2a18843 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.133789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 34/70] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=07cb4a4189484db884216c920f46ba3d => generated 259 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:16.143740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad322dd-9033-4e33-a401-9b74045867cf None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.145053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad322dd-9033-4e33-a401-9b74045867cf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.145506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:16.145720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad322dd-9033-4e33-a401-9b74045867cf None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.155625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 35/71] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:16.165096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931d28-21f7-4cec-88de-c5d4bd8fe861 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.165564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931d28-21f7-4cec-88de-c5d4bd8fe861 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.166035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c931d28-21f7-4cec-88de-c5d4bd8fe861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.177440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-29b37ab3-4342-4652-a0c3-3b16f04a0080 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:16.179617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 37/72] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:16.181955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664684c-2635-46d4-8515-01d0d843e9e7 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.182433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664684c-2635-46d4-8515-01d0d843e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.182904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664684c-2635-46d4-8515-01d0d843e9e7 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.186637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 38/73] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:16.187990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664684c-2635-46d4-8515-01d0d843e9e7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.200322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2c931d28-21f7-4cec-88de-c5d4bd8fe861 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:16.202212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2c931d28-21f7-4cec-88de-c5d4bd8fe861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:16.207731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664684c-2635-46d4-8515-01d0d843e9e7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.213057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.213890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.214177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.214458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.215353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.215739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.216090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:16.217862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.226059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.226676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.227103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.237069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 39/75] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.250101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.267821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:16.268658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eafc7-98e8-48da-a98b-65ce4fb27d81 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.270871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:16.278094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.279247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.279678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.280105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.282281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.286060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.289611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 40/76] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.295314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.298778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 37/77] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:16.307179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.324181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320aea0-6df3-406c-8053-dcf5edd2f79b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.342078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.345756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98483108-d579-4940-b6f4-669f6e0cc60b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.346182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.347107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.349175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.362174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.364953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.365847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.366599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.368462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:16.382990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:16.384539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.391927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 41/78] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:16.391927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.394918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.406536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770f195-4663-4bb0-a6cf-a45c56764616 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.412507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.413854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.414766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.414766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.420221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 38/79] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:16.422176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.439706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de7a00-6e06-435f-b59f-1ea11b3440dc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.443170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:16.449244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.450653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.451371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.452063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.453605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.454380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.457974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.458133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:16.466592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 42/80] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:16.466592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.484402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 39/81] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.484402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.494159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9355-c744-49bc-ae4c-0259841c311d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.499319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d83545-9e7f-472a-81a2-b5379ee3aa65 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.502450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.505569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.506731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.507287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.507763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] PATH_INFO: `/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.508390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.508876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.509405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.510873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.511574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] RBAC: Authorizing `identity:get_project(project_id=de83dd7a2edd4fa2af68ec56dbaa929c)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.511742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.514491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.516105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.520322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 43/82] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c => generated 312 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.522463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.545022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 40/83] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.545022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.547049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b02992-3096-4c47-9deb-1c35ac66c091 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.555573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.557187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.557769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.558248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.560456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.563890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.564877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbf3bf-ca02-4332-a56e-194630307d49 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.569006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 44/84] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.570837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.579950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.581213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.581928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.582512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.584398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=de83dd7a2edd4fa2af68ec56dbaa929c, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.584780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.588489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.591129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a275dd-058f-41a2-84d6-17f5ff0db805 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.598831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.604933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 41/85] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=de83dd7a2edd4fa2af68ec56dbaa929c&role.id=07cb4a4189484db884216c920f46ba3d => generated 259 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.604933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.605428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.608569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.611349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.616052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.621429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.635172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 45/86] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.639309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af3351-da63-4c09-9181-8344e3cd1fd3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.644615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.662358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.663396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.663878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.664350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.669644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43834e4-cbd6-48bf-addd-4aac5f8d40eb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.689034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.690164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.690635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.691274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.694342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.697485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.722755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.733880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb150f-1981-4aa3-90e0-cf81f261482d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.740767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:16.745184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.761889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:16.764366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7470a-ed75-4736-91dd-e570498e1ef0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.764846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7470a-ed75-4736-91dd-e570498e1ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.765344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7470a-ed75-4736-91dd-e570498e1ef0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.773434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23036915-25f7-4d0c-b87a-71c6d9951e8c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.774909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 47/89] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:16.775882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7470a-ed75-4736-91dd-e570498e1ef0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.781345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.782840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.783407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.783866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.786662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.790257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7470a-ed75-4736-91dd-e570498e1ef0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.791010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0c87d-3654-4dd3-baea-2593ac317335 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.794925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 43/90] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:16.796241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.797372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.797891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.798384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.799912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.803117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.803478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.803957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.804425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.805892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 48/91] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.811824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.823694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659af099-14e7-4b85-87c8-060748ce5676 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.829211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.830039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.830417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.830790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.832411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=15fad1a67004416983756cf42a1eae2d) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.832826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.833985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:16.833985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:16.833985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:16.835393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.843983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 49/92] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/role_assignments?user.id=15fad1a67004416983756cf42a1eae2d&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.845036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.852935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:16.856955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:16.866255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857340-f9c3-4510-a8aa-f53ac280e1c0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.879570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 44/93] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:16.884939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.886312 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.886830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.887344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.888833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:16.889439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.892945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.903778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 50/94] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=6d733f44594041f5bbc6de2766346027 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.918362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.935764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c7d55-0e3c-42ec-bca2-c1d84a52cc9b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.946759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.948253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.948943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.949486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.951837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.955169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de120b-a96f-4bfd-ae19-5ea2105ab36d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:16.958809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 45/95] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:16.965174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:16.982902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42dd42-7b55-479f-a8a8-134bf529c26a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:16.992351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:16.994002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:16.994466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:16.994923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:16.996285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:16.998556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:16.998556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:16.998556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:17.000926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b784b48b-d833-4d7d-95f2-0d0d20415bca admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:17.076673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 51/96] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:16 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:18.642053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2937f9-0b15-4685-8154-0d82252760e9 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.643122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2937f9-0b15-4685-8154-0d82252760e9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.643629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2937f9-0b15-4685-8154-0d82252760e9 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.646515 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 46/97] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:18.652513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.653476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.653981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.678714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:18.680327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:18.696920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 52/98] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:18.787349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2937f9-0b15-4685-8154-0d82252760e9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:18.804410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2937f9-0b15-4685-8154-0d82252760e9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:18.812750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:18.813924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.814430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.814923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.830733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:18.838618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:18.840132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 47/99] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:18.849341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:18.862353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d022c-bb81-4b2e-870f-0cad0864841a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:18.870515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:18.871545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.872036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.872512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.873547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:18.874057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:18.876000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:18.889700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 53/100] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:18.898778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:18.910959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552087b-6b01-4985-a3ec-7edb7f331dff admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:18.920874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:18.922162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.922648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.923124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.924696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:18.927860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:18.929812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 48/101] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:18 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:18.938320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:18.949521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556846e5-a942-4768-9b14-27e6b3d8fcd9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:18.957476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:18.958731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.959221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.959704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.961383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:18.963780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc31792-06f9-455b-b530-c15b5c9092b8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:18.965851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 54/102] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:18 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:18.974982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:18.985935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1903-de01-4de3-a06e-e561c2407e73 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:18.993255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:18.994593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:18.995148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:18.995626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/e2208699c62945bcabada032ea5b0722/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:18.998038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, user_id=e2208699c62945bcabada032ea5b0722, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:18.999333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:18.999333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:18.999333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:19.001833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d72279-9b97-4147-b2b6-767f5e477d2e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:19.037813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 49/103] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:18 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/e2208699c62945bcabada032ea5b0722/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:20.960089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b9fd-31a1-434b-8ea2-b51c8da01caa None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:20.961142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b9fd-31a1-434b-8ea2-b51c8da01caa None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:20.961634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b9fd-31a1-434b-8ea2-b51c8da01caa None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:20.963906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 55/104] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:20.970180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b877de-412c-4af0-b3cc-e9be1874f940 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:20.971111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b877de-412c-4af0-b3cc-e9be1874f940 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:20.971594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b877de-412c-4af0-b3cc-e9be1874f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:20.998123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c7b877de-412c-4af0-b3cc-e9be1874f940 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:20.999686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c7b877de-412c-4af0-b3cc-e9be1874f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:21.075204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 50/105] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:21.100433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b9fd-31a1-434b-8ea2-b51c8da01caa None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.115011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b9fd-31a1-434b-8ea2-b51c8da01caa None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.120311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.121660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.122188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.122692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.138621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a442-ecb7-4321-a3f6-e54ff35d520a None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.139243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a442-ecb7-4321-a3f6-e54ff35d520a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.139736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62a442-ecb7-4321-a3f6-e54ff35d520a None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.141899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 51/106] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:21.143612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:21.151835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.152456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.152960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.160273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:21.164980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 56/107] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:21.181512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:21.183151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:21.186047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.200008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa4cab-0e85-4779-84a8-dfe236d088d9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.209359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 52/108] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:21.210887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.211826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.212317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.212858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.213916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:21.214441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.216358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.226695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 57/109] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:21.232639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.244245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5832679-10c4-4665-ab98-bf81619f58bb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.249621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.250870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.251366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.251866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.254165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.256854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.259465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 53/110] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:21.265679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.277497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13e9c-7f55-48cc-a571-0f7b72904cb6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.282682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.283975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.284587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.285855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] PATH_INFO: `/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.287595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=de83dd7a2edd4fa2af68ec56dbaa929c)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.290270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.299113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.304178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de72eef-5d34-436f-86fc-d69c8cfecc47 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.306269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 58/111] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:21.313503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.318577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.325408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.325965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.326454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.338145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb969a4-b2aa-4790-9f61-1719acee31a9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.351250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.353388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.354624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.357657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] PATH_INFO: `/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c/users/e2208699c62945bcabada032ea5b0722/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.361932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:21.364250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de83dd7a2edd4fa2af68ec56dbaa929c, user_id=e2208699c62945bcabada032ea5b0722, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.381148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.394450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:21.397828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 54/112] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:21.411394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.427726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 59/113] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:21 2022] PUT /identity/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c/users/e2208699c62945bcabada032ea5b0722/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:21.442822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc905fc-ce96-4f4a-b28c-f0fa1f162935 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.560072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.561115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.561739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.562232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.563689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:21.564239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.567921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.585325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 55/114] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:21.594350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.613153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c6e8b-c897-4e05-af1c-0c476880d274 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.621853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.623304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.623787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.624261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.626787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.631350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.634513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 60/115] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:21.643957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.664206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67eb654-acec-4db5-b645-47bfb89ab503 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.672104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.673725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.674217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.674702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.677790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.681961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aba0c3-3665-46e0-a21c-49d6f7df8a42 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.693015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 56/116] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:21 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:21.695078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:21.713746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7339e8-d437-4c45-aab9-a74d8f7a862c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:21.721842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:21.723531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.724003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.724483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/e2208699c62945bcabada032ea5b0722/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.728747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, user_id=e2208699c62945bcabada032ea5b0722, role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:21.734338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9254f0-7e7d-4c8e-8dda-0bc88e878b2d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:21.761535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 61/117] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:21 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/e2208699c62945bcabada032ea5b0722/roles/6d733f44594041f5bbc6de2766346027 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:21.864298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdb35-0450-4bd7-97b3-c0905f2bc576 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.864830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdb35-0450-4bd7-97b3-c0905f2bc576 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.865328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bdb35-0450-4bd7-97b3-c0905f2bc576 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.868628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 57/118] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:21.876982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:21.877403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:21.877813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:21.916608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:21.919022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:22.027978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 62/119] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:22.065667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bdb35-0450-4bd7-97b3-c0905f2bc576 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.102566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bdb35-0450-4bd7-97b3-c0905f2bc576 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.114810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.116186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.116688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.117230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.140529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:22.148739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-866c7e29-83b2-438a-bf1c-1080aa2c5bb6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:22.152597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 58/120] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:22.158794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.169474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29629894-c47e-418a-b55e-cd95ac54b9b7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.180147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e18db-8987-4153-8dcb-a38c0e309145 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.180356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.180975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.181196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e18db-8987-4153-8dcb-a38c0e309145 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.181308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.181550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.182018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e18db-8987-4153-8dcb-a38c0e309145 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.182335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:22.182649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.184331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda89a5-0049-4db8-b793-e18961f0f16e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.184841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 59/121] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:22.198127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 63/122] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:22.204381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e18db-8987-4153-8dcb-a38c0e309145 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.220436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e18db-8987-4153-8dcb-a38c0e309145 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.226723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.228032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.228518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.229049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.230788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.233067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.235105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 60/123] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:22 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:22.241979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.242603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.243085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.264081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:22.265927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:22.275316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 64/124] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:22.277211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.290113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607517-a2b9-4850-9dc4-25560ea47b83 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.295317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.296539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.297130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.297687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.299258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.301770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.303891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 61/125] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:22 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:22.309839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.320597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee9bb6-cb41-4e1d-82b8-6b91b7caa289 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.321987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.332513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.333948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.334989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.336007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/15fad1a67004416983756cf42a1eae2d/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.339926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, user_id=15fad1a67004416983756cf42a1eae2d, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.344431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495b431-d622-41bb-a270-5fb3fab44457 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.347877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720725eb-f72f-4baa-bbcf-2cebc32140d2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.355331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.357600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.357600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.357825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.359829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.364227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.364227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 62/126] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:22.370468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:22.384881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 65/127] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:22 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/15fad1a67004416983756cf42a1eae2d/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:22.386325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a57e69-7ed7-4915-8aeb-c69ae251a77c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:22.471401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:22.473187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:22.473659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:22.474120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:22.475067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:22.478773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f373c-80bd-4365-877a-5a2b4faf790e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:22.538126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 63/128] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:06:22 2022] POST /identity/v3/projects => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:23.542715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5905-1d78-44ba-bbb6-8e46aefb357f None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.543228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5905-1d78-44ba-bbb6-8e46aefb357f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.543675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc5905-1d78-44ba-bbb6-8e46aefb357f None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.547072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 66/129] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:23.556417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.556969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.557046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.590203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:23.591435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:23.669626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 64/130] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:23.696158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc5905-1d78-44ba-bbb6-8e46aefb357f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:23.726433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc5905-1d78-44ba-bbb6-8e46aefb357f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:23.739956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:23.741407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.741927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.742432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.768209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:23.788049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:23.791056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 67/131] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:23.797014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:23.812921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914badee-20a0-47ab-9d3d-4d4f61180564 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:23.829745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:23.830820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.831350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.831833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.833040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:23.833556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:23.835449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:23.845108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 65/132] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:23.851597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:23.876370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81797497-ae00-4895-ad1b-28e368d70235 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:23.892277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:23.894007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.894572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.895178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] PATH_INFO: `/v3/users/17da363ebbe141919a47eb044ce1fde6` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.928379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] RBAC: Authorizing `identity:get_user(user_id=17da363ebbe141919a47eb044ce1fde6)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:23.932254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:23.935683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 68/133] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:23 2022] GET /identity/v3/users/17da363ebbe141919a47eb044ce1fde6 => generated 289 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:23.941195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:23.954440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8d36-ee4c-480a-8194-87395712efab admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:23.970899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:23.972837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:23.973408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:23.973891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:23.990086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:23.992294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:24.004101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 66/134] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:24.010180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.037416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8aa6-f8fa-4592-a80c-074c9b7ab379 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:24.052115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:24.053557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.054073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.054579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.057029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:24.061353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67d0b9-0394-40de-882c-3561cce49449 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:24.064727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 69/135] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:24.071648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.081661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38662f-ea10-42d0-b042-ff74aac3f683 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:24.092180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:24.093320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.093836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.094325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.095483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=17da363ebbe141919a47eb044ce1fde6) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:24.096057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:24.099426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c0c6b-a353-4390-a664-ec0776d06903 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:24.106641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 67/136] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/role_assignments?user.id=17da363ebbe141919a47eb044ce1fde6&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=ecbd65ff633045519ad8576a34564b44 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:24.622972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437a67-c544-4037-b009-9a4b321a2078 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.623514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437a67-c544-4037-b009-9a4b321a2078 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.623859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab437a67-c544-4037-b009-9a4b321a2078 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.629400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 70/137] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:24.641184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.641701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.642128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.679917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:24.681893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:24.696786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 68/138] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:24.764930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab437a67-c544-4037-b009-9a4b321a2078 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.793651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab437a67-c544-4037-b009-9a4b321a2078 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:24.807001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:24.808355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.808887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.809382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.834782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:24.852203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:24.854518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 71/139] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:24.863743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.886696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd2e04-2d48-46d7-b2de-c62a91f1d0bb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:24.899450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:24.900615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.901240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.901747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.903164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:24.903693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:24.906769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:24.926857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 69/140] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:24.935634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.953675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cb927-a9aa-4773-a626-ff525a71c089 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:24.961612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:24.963015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:24.963474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:24.963923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:24.965890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:24.969651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:24.973087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 72/141] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:24.980975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:24.995829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96ef7f-f544-4113-b3d1-b60734e1f130 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:25.000733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:25.001550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:25.001841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:25.002124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:25.017936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:25.019791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:25.030799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 70/142] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:25.038956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:25.049096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dacfa-08de-4132-930f-61e96b7a6911 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:25.059587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:25.060521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:25.060810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:25.061119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:25.062440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:25.064683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e808a7-a674-475d-b907-926d8721312b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:25.067113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 73/143] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:25 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:25.075342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:25.085696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c204ba3-5b09-49a3-92d8-c272e1e0d163 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:25.091349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:25.092270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:25.092751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:25.093199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:25.094280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:25.094823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:25.101301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4ac07-5a94-4564-b610-ba3688b04409 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:25.108382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 71/144] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:25 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=07cb4a4189484db884216c920f46ba3d => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:25.989221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad346d-9c99-460d-96d6-6ec0aa489b94 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:25.989740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad346d-9c99-460d-96d6-6ec0aa489b94 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:25.989740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad346d-9c99-460d-96d6-6ec0aa489b94 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:25.991766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 74/145] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:25.998164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:25.998679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:25.998780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.022363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:26.023676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:26.035440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 72/146] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:26.080227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad346d-9c99-460d-96d6-6ec0aa489b94 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.099023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad346d-9c99-460d-96d6-6ec0aa489b94 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.103920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.104777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.105141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.105430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.126291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:26.134291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:26.135637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 75/147] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:26.142157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.154869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653d570-0d3c-42c8-b11a-a9de0b7dc6a7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.161269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.161971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.162309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.162594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.163396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:26.163707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.165522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.179555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 73/148] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.185687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.197519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089db292-e7ae-4352-bd09-67475fc605f8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.205520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.207303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.207898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.208379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.212463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.215184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.217299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 76/149] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.223910 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.238725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13789339-5c03-4f1a-a0b5-b670fd8953ab admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.246080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.246738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.247028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.247319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.261429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.263337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.278958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 74/150] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:26.285006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.298626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8cf18-d4a1-4cfa-b4e3-5b2f59fa8df8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.309069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.310231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.310715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.311207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] PATH_INFO: `/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.317740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] RBAC: Authorizing `identity:get_project(project_id=de83dd7a2edd4fa2af68ec56dbaa929c)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.320121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacc8a0-c2ec-486b-a1a8-1bc009286f94 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.322143 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 77/151] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/projects/de83dd7a2edd4fa2af68ec56dbaa929c => generated 312 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.328365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.342430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5f5cb-ad0d-452f-915a-83381441be7f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.350297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.351027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.351317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.351654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.352511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=de83dd7a2edd4fa2af68ec56dbaa929c, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:26.352878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.354931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed19e-faea-434a-a0b6-38f4a6eaa360 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.366674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 75/152] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=de83dd7a2edd4fa2af68ec56dbaa929c&role.id=07cb4a4189484db884216c920f46ba3d => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.516247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe847e-e7e1-44f6-a79a-3cddfe04a15e None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.516920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe847e-e7e1-44f6-a79a-3cddfe04a15e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.517471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe847e-e7e1-44f6-a79a-3cddfe04a15e None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.519657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d852-a6ec-4aa7-8a02-bda9eaf45fd4 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.519952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d852-a6ec-4aa7-8a02-bda9eaf45fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.520239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28d852-a6ec-4aa7-8a02-bda9eaf45fd4 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.521063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 78/153] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:26.522370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 76/154] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:26.527879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.528178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.528373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.528665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.529074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.529549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.564098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:26.565464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:26.567469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:26.569065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:26.585906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 79/155] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:26.586428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 77/156] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:26.612964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.626616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49bd8e-1c74-4bea-b175-f3cb51c8d6bc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.627949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.636449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.637268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.637551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.637825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.639050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.639620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98928bb3-42d7-4d35-8114-8c3979b9c57f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.641561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.643296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 80/157] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.647425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.648446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.654365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.654880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.655302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.662606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cb215-bd70-4ef9-9840-64543d6069af admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.668304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.669161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.669577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.669953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.671113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.671736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:26.673696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.680264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:26.681755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 78/158] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:26.696658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.712097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 81/159] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:26 2022] POST /identity/v3/users => generated 283 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:26.712692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a727a-4ab8-4a72-a11c-3a3c5bc6bb2c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.721544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.722742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.723170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.723676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.724680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:26.725799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.727777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab436dd-8b02-4740-84da-efb7d4f5a87d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.740293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 79/160] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.748573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.751749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c43b-924d-46bf-800f-0427d374969e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.752156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c43b-924d-46bf-800f-0427d374969e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.752570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0c43b-924d-46bf-800f-0427d374969e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.756884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 80/161] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:26.766832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72904f-3fb6-4994-97c8-e10ae96246f9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.768248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.768429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.769617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.774138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.775335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.776760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.777422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] PATH_INFO: `/v3/users/15fad1a67004416983756cf42a1eae2d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.779074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] RBAC: Authorizing `identity:get_user(user_id=15fad1a67004416983756cf42a1eae2d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.781428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.783533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 82/162] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/users/15fad1a67004416983756cf42a1eae2d => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:26.794568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.808628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:26.810792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:26.817771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634f6e6-eef0-4c4c-ab8a-e95fbd302037 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.825991 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.827032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.827514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.827986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.832372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 81/163] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:26.838440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.840773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.851317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 83/164] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:26.861201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.882847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.888275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ba237-79b6-420c-8209-9a780663a6e2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.894571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e2507-0979-492b-9a66-2c2d758281fa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.896520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.898316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.898736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.900226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.902658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.905167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.907520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.908690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.909204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.910437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.913102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 82/165] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.919643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.931397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6767f11-c67e-403a-acc2-9ade70d67597 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.936697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.937816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.938351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.938860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.939965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=15fad1a67004416983756cf42a1eae2d) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:26.941276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.943581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:26.944016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:26.957093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 83/166] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/role_assignments?user.id=15fad1a67004416983756cf42a1eae2d&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:26.959618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:26.962051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 84/167] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:26.971627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:26.983517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badd6a2-4a9e-4b3e-bb81-4375daa992f3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:26.989739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:26.990601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:26.991007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:26.991374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:26.992296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:26.992680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:26.994611 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:27.006170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 84/168] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:27.016748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:27.039120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c4e4e-8dd7-4f5e-bda7-091205b7f55c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:27.052342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:27.054474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:27.055306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:27.056082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] PATH_INFO: `/v3/users/e2208699c62945bcabada032ea5b0722` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:27.059180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] RBAC: Authorizing `identity:get_user(user_id=e2208699c62945bcabada032ea5b0722)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:27.064230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:27.068618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 85/169] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:27 2022] GET /identity/v3/users/e2208699c62945bcabada032ea5b0722 => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:27.077497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:27.096556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0e88a-db30-481e-b1c5-bdcc1f9146d5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:27.105415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:27.106954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:27.107702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:27.108410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:27.124715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:27.129415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:27.148227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 85/170] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:27.157831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:27.178305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1996-d66e-4828-8252-8602c4f777ff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:27.185209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:27.186073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:27.186345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:27.186624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:27.188456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:27.191387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9de711-7fae-4954-bc71-ad78a6ceeddb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:27.195998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 86/171] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:27 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:27.203128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:27.220783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d02c85-d945-48a8-a97c-95d1a33da2c6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:27.229920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:27.231040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:27.231520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:27.232037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:27.233623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=e2208699c62945bcabada032ea5b0722) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:27.234170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:27.238641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc709841-97c7-4c4b-8e4e-f7898b61b690 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:27.254029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 86/172] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:27 2022] GET /identity/v3/role_assignments?user.id=e2208699c62945bcabada032ea5b0722&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=6d733f44594041f5bbc6de2766346027 => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:28.006325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8480b-a9b2-4a21-b728-1bef7a67acd6 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.006739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8480b-a9b2-4a21-b728-1bef7a67acd6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.007125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8480b-a9b2-4a21-b728-1bef7a67acd6 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.009042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 87/173] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:28.018491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.019495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.020157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.052183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:28.053901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:28.062497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 87/174] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:28.100444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8480b-a9b2-4a21-b728-1bef7a67acd6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:28.118374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8480b-a9b2-4a21-b728-1bef7a67acd6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:28.123193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:28.124008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.124291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.124567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.138793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:28.146169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:28.147675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 88/175] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:28.153760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:28.163778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf15f33-ccd8-4e7b-93df-482ddb934a52 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:28.168484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:28.169197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.169478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.169810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.170588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:28.170895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:28.172514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:28.182849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 88/176] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:28.187993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:28.199163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914c96e-ffba-4da3-a751-64e266c8e941 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:28.203934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:28.204939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.205229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.205510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] PATH_INFO: `/v3/users/17da363ebbe141919a47eb044ce1fde6` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.207665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] RBAC: Authorizing `identity:get_user(user_id=17da363ebbe141919a47eb044ce1fde6)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:28.209873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:28.211885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 89/177] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:28 2022] GET /identity/v3/users/17da363ebbe141919a47eb044ce1fde6 => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:28.217647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:28.231492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dec3df-75c8-4b31-8ea2-842f5d49e763 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:28.236378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:28.237373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.237639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.237962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.239288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:28.241620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68939e-038e-4cce-9941-ca8a3d7acf1d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:28.243382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 89/178] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:28 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:28.249205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:28.260004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8527-1ff2-4478-84ec-39b8f5819aef admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:28.264812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:28.265759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:28.266039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:28.266308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/17da363ebbe141919a47eb044ce1fde6/roles/ecbd65ff633045519ad8576a34564b44` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:28.268429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, user_id=17da363ebbe141919a47eb044ce1fde6, role_id=ecbd65ff633045519ad8576a34564b44)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:28.271680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fda59c-96bb-4c37-890d-2493417fd758 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:28.290484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 90/179] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:28 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/users/17da363ebbe141919a47eb044ce1fde6/roles/ecbd65ff633045519ad8576a34564b44 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:29.673446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c3fd-45d3-4b4e-a04d-b59a4afafe06 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.674172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c3fd-45d3-4b4e-a04d-b59a4afafe06 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.674172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c3fd-45d3-4b4e-a04d-b59a4afafe06 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.676531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 90/180] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:29.683067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.683700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.683700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.703330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:29.704530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:29.766794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 91/181] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:29.792034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c3fd-45d3-4b4e-a04d-b59a4afafe06 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.804815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c3fd-45d3-4b4e-a04d-b59a4afafe06 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.809221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:29.810039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.810325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.810601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.821890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:29.829284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:29.836086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 91/182] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:29.837483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.847502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65a432-dfea-41fb-8920-0f73ad4c3018 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.852253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:29.852942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.853230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.853504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.854279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:29.854588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:29.856237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:29.865986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 92/183] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:29.871664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.884020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54207976-1aad-4247-b663-7ffe436721d6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.889052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:29.889936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.890220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.890491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.907367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:29.910225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e447f2-afa1-448d-8d42-afaf5d8ac42a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:29.912167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 92/184] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:29.917850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.922804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412ec4a-c6f7-4a38-b77b-1fe179f98bc8 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.923088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412ec4a-c6f7-4a38-b77b-1fe179f98bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.923370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412ec4a-c6f7-4a38-b77b-1fe179f98bc8 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.925746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 93/185] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:29.931317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cad3c-9e24-4e36-a6fd-a440b0fc6d4a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.931599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.931830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.932107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.936780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:29.937745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.938226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.938725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.947915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:29.950099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:29.950815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:29.952012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:29.961012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 93/186] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:29.965711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 94/187] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:29.967338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.978033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba2fc2-68b6-4982-9801-16769df5cd50 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.982940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:29.984138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:29.984619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:29.985209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:29.986170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:29.986954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:29.990200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:29.992293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 95/188] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:29.996637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a1b48-5c5a-4723-9a9f-376c37e053a4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:29.998808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.001569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.002455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.002740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.003046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.004301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.006061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.007737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 94/189] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:30.011452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000484b6-5419-45b2-8c5d-ec575c0bd48b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.013604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.017184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.018315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.018881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.019402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.020636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=b3e90558cbbb4b87a2ef481e5f12eadc) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:30.021233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.023560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73f643-4c7b-48f1-8b76-5f27c0ed198b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.024128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e642c0-6d5e-49b4-bc87-8edd03b03c16 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.029157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.029907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.030190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.030467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.031282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.031955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 96/190] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:29 2022] GET /identity/v3/role_assignments?user.id=b3e90558cbbb4b87a2ef481e5f12eadc&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=6d733f44594041f5bbc6de2766346027 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:30.037040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7067-4ef2-402d-a07e-82d46d55d116 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.062108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 95/191] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:30 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:30.222805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c3f-9ac5-4d78-9675-3a116efdc9e4 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.223143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c3f-9ac5-4d78-9675-3a116efdc9e4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.223579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2c3f-9ac5-4d78-9675-3a116efdc9e4 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.226787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 97/192] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:30.236729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.237786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.238244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.264538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:30.265850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:30.280304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 96/193] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:30.308110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2c3f-9ac5-4d78-9675-3a116efdc9e4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.325058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2c3f-9ac5-4d78-9675-3a116efdc9e4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.329624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.330452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.330735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.331009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.344608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:30.352883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:30.354244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 98/194] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:30.360407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.372053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6cd71-5a50-4667-9c96-73e602647b53 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.376703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.377423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.377701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.378097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.379657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:30.380203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.381847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.391545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 97/195] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:30.398436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.412116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229021-2833-41ac-8865-7841738c75da admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.416760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.417755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.418024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.418387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.419727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.421942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.427187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 99/196] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:30.432609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.444293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7f01-c0b7-4814-be9c-92bb3bbadd1c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.449051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.449709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.450041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.450308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.460772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.462708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.475278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 98/197] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:30.481181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.498011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b84264-97c9-4f17-997e-67df670216f8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.502792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.504404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.504693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.505000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.507230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.509528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d686b-6937-4fdb-af5d-95f0ff4af4c6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.512590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 100/198] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:30.518433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:30.528718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0b49d-7354-4b18-9692-11975b868b2d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:30.538909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:30.539953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:30.540502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:30.541034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:30.542158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=b3e90558cbbb4b87a2ef481e5f12eadc) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:30.542667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:30.544962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dd4f3-d105-421c-a5af-c1e940367153 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:30.557384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 99/199] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:30 2022] GET /identity/v3/role_assignments?user.id=b3e90558cbbb4b87a2ef481e5f12eadc&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:31.751032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c229b-4466-4d22-b368-5b9e26de2e06 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:31.751544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c229b-4466-4d22-b368-5b9e26de2e06 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:31.752008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c229b-4466-4d22-b368-5b9e26de2e06 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:31.757862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 101/200] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:31.764178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:31.765202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:31.765695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:31.797931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:31.800362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:31.815482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 100/201] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:31.885190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c229b-4466-4d22-b368-5b9e26de2e06 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:31.914002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c229b-4466-4d22-b368-5b9e26de2e06 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:31.927552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:31.928997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:31.929483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:31.929973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:31.962357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:31.981119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:31.983839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 102/202] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:31.992392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:32.008701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c5cc2-baa5-41ed-ac64-b4757481bbc7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:32.015460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:32.016325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:32.016701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:32.017097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:32.018028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:32.018432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:32.021210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:32.043651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 101/203] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:32.052782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:32.081832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd95ee3-feb5-411e-8ffe-3f6d56bb32a3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:32.095860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:32.098014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:32.098483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:32.098941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] PATH_INFO: `/v3/users/17da363ebbe141919a47eb044ce1fde6` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:32.105884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] RBAC: Authorizing `identity:get_user(user_id=17da363ebbe141919a47eb044ce1fde6)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:32.110075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:32.114307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 103/204] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:32 2022] GET /identity/v3/users/17da363ebbe141919a47eb044ce1fde6 => generated 289 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:32.121929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:32.142941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa475-64df-4046-9d11-1e2a63a80a95 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:32.149248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:32.149960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:32.150239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:32.150507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:32.169319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:32.171547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:32.188919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 102/205] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:32.198403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:32.233395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58be20-9364-47b2-b017-3670a5083aaa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:32.247117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:32.248631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:32.249150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:32.249637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:32.258505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:32.262819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd268-3f8d-42cc-b692-c9588f3df38c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:32.266709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 104/206] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:32 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:32.276028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:32.290858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae07491-444d-4420-ad42-522ecffb7eba admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:32.299283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:32.300023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:32.300500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:32.301013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:32.301970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, scope.project.id=2a1c6b544b404e63a97221c73a9ace10, user.id=17da363ebbe141919a47eb044ce1fde6) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:32.302286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:32.304299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aee33e-6828-4c2a-9f6f-36c87d831d54 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:32.319299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 103/207] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:32 2022] GET /identity/v3/role_assignments?user.id=17da363ebbe141919a47eb044ce1fde6&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=ecbd65ff633045519ad8576a34564b44 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:33.035905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed8f2-d74c-4fb2-a885-94af44a08e43 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.036657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed8f2-d74c-4fb2-a885-94af44a08e43 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.036806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bed8f2-d74c-4fb2-a885-94af44a08e43 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.040139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 105/208] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:33.048141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.048769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.048769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.071948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:33.073161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:33.084294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 104/209] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:33.129555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed8f2-d74c-4fb2-a885-94af44a08e43 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.150697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bed8f2-d74c-4fb2-a885-94af44a08e43 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.157760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.159127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.160110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.160593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.181381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:33.196163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:33.198428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 106/210] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:33.208433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.218183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0777fbe-2b38-4d87-bb9d-e7c1fd4dd624 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.232976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.232976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.232976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.232976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.233550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:33.233550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:33.237036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:33.255068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 105/211] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:33.265019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.275522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ec6fa-a61f-45bf-b902-3e9c15adfeb2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.290475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.292434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.293226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.293943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] PATH_INFO: `/v3/users/6f99cfd8f8fa4d7aa5837d356a814446` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.322202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] RBAC: Authorizing `identity:get_user(user_id=6f99cfd8f8fa4d7aa5837d356a814446)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:33.326524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:33.329887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 107/212] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/users/6f99cfd8f8fa4d7aa5837d356a814446 => generated 297 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:33.338416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.357831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4af7f3-3783-487d-9005-3525dde17fac admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.366745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.368440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.369212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.369993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.387565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:33.391646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:33.410264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 106/213] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:33.419921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.439333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699b5b-1293-4028-a9ea-7ea9e72cc35c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.448650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.450918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.451801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.452557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.455415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:33.460283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705aed6-c640-442d-afa0-6693dd354cf9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:33.464337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 108/214] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:33.474022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:33.492681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2952-73eb-4950-961a-bc5e931c0829 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:33.500812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:33.502483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.504296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.505122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.507115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=6f99cfd8f8fa4d7aa5837d356a814446) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:33.508017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:33.512286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783b5a8-e49e-495f-9a69-891b08383b89 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:33.524571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 107/215] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:33 2022] GET /identity/v3/role_assignments?user.id=6f99cfd8f8fa4d7aa5837d356a814446&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=07cb4a4189484db884216c920f46ba3d => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:33.969669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21914-2f28-4224-95b0-a20d544eb3e5 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.970150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21914-2f28-4224-95b0-a20d544eb3e5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.970291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e21914-2f28-4224-95b0-a20d544eb3e5 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:33.973571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 109/216] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:33.979470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3659e23-b827-4143-b23a-aa7a64840cfe None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:33.979660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3659e23-b827-4143-b23a-aa7a64840cfe None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:33.979994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3659e23-b827-4143-b23a-aa7a64840cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.009282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e3659e23-b827-4143-b23a-aa7a64840cfe None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:34.011582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e3659e23-b827-4143-b23a-aa7a64840cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:34.025252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 108/217] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:34.051909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21914-2f28-4224-95b0-a20d544eb3e5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.066150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e21914-2f28-4224-95b0-a20d544eb3e5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.071117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.072088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.072472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.072850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.074329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.076207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.078054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 110/218] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:34.084530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.085192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd3dd-fde0-4585-8971-eaf4f9dc2267 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.085847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd3dd-fde0-4585-8971-eaf4f9dc2267 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.086277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bd3dd-fde0-4585-8971-eaf4f9dc2267 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.090109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 109/219] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:34.099569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dac24-0493-44fc-8f98-d2b01d8a69f8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.099982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.100403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.101081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.105858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.107086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.107579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.108132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.109666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.114410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.134059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:34.135487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:34.146026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 111/220] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:34 2022] POST /identity/v3/users => generated 297 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:34.156714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 110/221] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:34.201014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.213044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cfed-12a9-45cb-9e4d-29a09fa84b01 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.218231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.219069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.219401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.219679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.234209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:34.242733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:34.244005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 112/222] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:34.254298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.274066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a62e8-a52e-4b71-b485-3f032ab9ae84 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.288448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.290050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.290753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.291424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.293096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:34.293885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.297246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.314250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 111/223] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:34.324433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.343371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a962-08b9-492a-984d-a757495a7e07 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.351140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.352728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.353390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.353956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.356029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.360241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.364199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 113/224] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:34.373623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.391892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a0a24-a37b-43e8-bcd1-7a15902a682e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.399935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.401548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.402107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.402601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.404887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.409917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667eb035-5fd6-478f-a3f8-f77a67856ebf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.413387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 112/225] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:34.422992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.441368 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493df1d-592c-4803-b754-5bda19a09ca5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.448686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.450319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.450804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.451298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/b3e90558cbbb4b87a2ef481e5f12eadc/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.455259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, user_id=b3e90558cbbb4b87a2ef481e5f12eadc, role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:34.460786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe73a17f-4bd1-49fb-b876-bb96aff2ec6b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:34.497136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 114/226] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:34 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/b3e90558cbbb4b87a2ef481e5f12eadc/roles/6d733f44594041f5bbc6de2766346027 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:34.753925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87353cc-a47b-438d-8e8f-1b45b0da9254 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.753925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87353cc-a47b-438d-8e8f-1b45b0da9254 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.754415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87353cc-a47b-438d-8e8f-1b45b0da9254 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.757946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 113/227] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:34.766218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.766860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.767328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:34.790779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:34.792295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:34.875954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 115/228] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:34.940317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87353cc-a47b-438d-8e8f-1b45b0da9254 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:34.971353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87353cc-a47b-438d-8e8f-1b45b0da9254 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:34.982302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:34.983622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:34.984114 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:34.984560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:35.005029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:35.019503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:35.021577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 114/229] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:35.030386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:35.046713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a111-f312-41dd-a543-7624f2256103 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:35.057191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:35.058686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:35.059189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:35.059662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:35.060660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:35.061217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:35.067646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:35.078840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 116/230] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:35.087777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:35.110557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e00f6-31e5-462f-803a-e9ae5d7c165a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:35.123764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:35.125423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:35.125974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:35.126457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:35.129673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:35.134059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:35.142269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 115/231] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:35 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:35.151303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:35.171187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f08a4c-4237-4872-95a7-73a3bfb647e6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:35.181564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:35.182905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:35.183397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:35.183998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:35.185635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:35.188101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781ada-b722-4a36-9d18-bbfa3c94966d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:35.190992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 117/232] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:35 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:35.200757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:35.227972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48864f-6d4c-43b0-b5cf-99f33430b23e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:35.245624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:35.247442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:35.247929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:35.248384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/b3e90558cbbb4b87a2ef481e5f12eadc/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:35.252471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, user_id=b3e90558cbbb4b87a2ef481e5f12eadc, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:35.266235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b93c5-30d7-4164-9b89-ef2c23ebe3c9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:35.305335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 116/233] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:35 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/b3e90558cbbb4b87a2ef481e5f12eadc/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:36.866799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4c4d-6040-4ed6-8b77-992683aa7090 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:36.867819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4c4d-6040-4ed6-8b77-992683aa7090 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:36.868494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c4c4d-6040-4ed6-8b77-992683aa7090 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:36.872045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 118/234] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:36.881573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:36.882125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:36.882382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:36.922527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:36.924198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:37.014923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 117/235] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:37.085497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4c4d-6040-4ed6-8b77-992683aa7090 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:37.104604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c4c4d-6040-4ed6-8b77-992683aa7090 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:37.114860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:37.116074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:37.116566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:37.117127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:37.138147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:37.146803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:37.148480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 119/236] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:37.154671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:37.170679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ef4bc-4099-4907-a6bc-6c2ca55d68af None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:37.181773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:37.182855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:37.183333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:37.183796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:37.185131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:37.185671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:37.187537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:37.198561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 118/237] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:37.204877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:37.218751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa4469-c131-4c7a-aa1c-be4b7cb94755 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:37.226906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:37.228163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:37.228646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:37.229143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] PATH_INFO: `/v3/users/6f99cfd8f8fa4d7aa5837d356a814446` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:37.230775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f99cfd8f8fa4d7aa5837d356a814446)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:37.233235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:37.235199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 120/238] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:37 2022] GET /identity/v3/users/6f99cfd8f8fa4d7aa5837d356a814446 => generated 297 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:37.241663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:37.259057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02bf72-e0cc-40d4-8b58-d72da14bcb1e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:37.267614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:37.269909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:37.270503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:37.270994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:37.277827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:37.280256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e92bb-c156-40c7-b3a2-85f0970138b8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:37.282332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 119/239] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:37 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:37.289558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:37.306931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fde9f-94b1-4d68-9902-9678e1dfce75 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:37.314558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:37.316656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:37.317261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:37.317820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/6f99cfd8f8fa4d7aa5837d356a814446/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:37.320190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, user_id=6f99cfd8f8fa4d7aa5837d356a814446, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:37.323348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14bbf7-336b-4555-af9f-d57ca087e642 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:37.357416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 121/240] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:37 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/6f99cfd8f8fa4d7aa5837d356a814446/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:38.562264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8241e-243e-493f-99c8-b537f566c262 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.563232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8241e-243e-493f-99c8-b537f566c262 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.563713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8241e-243e-493f-99c8-b537f566c262 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.566496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 120/241] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:38.573773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496cb2-cab5-4bc2-9847-4897152351b7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.574365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496cb2-cab5-4bc2-9847-4897152351b7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.574762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09496cb2-cab5-4bc2-9847-4897152351b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.614569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-09496cb2-cab5-4bc2-9847-4897152351b7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:38.616598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-09496cb2-cab5-4bc2-9847-4897152351b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:38.725657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 122/242] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:38.761680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8241e-243e-493f-99c8-b537f566c262 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:38.790544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8241e-243e-493f-99c8-b537f566c262 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:38.800703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:38.801562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.801843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.802117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.820289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:38.822187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ae8d-03b5-4a23-9b8c-bcb1e3fa601f None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.822691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ae8d-03b5-4a23-9b8c-bcb1e3fa601f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.823118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154ae8d-03b5-4a23-9b8c-bcb1e3fa601f None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.828781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:38.830268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 121/244] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:38.835773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 123/244] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:38.837083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:38.849886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.850330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.850771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.854145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6586d-209f-4149-809d-30f3d78ba570 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:38.864265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:38.865339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.865817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.866302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.867274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:38.868390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:38.871151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:38.891553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:38.894485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 122/245] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:38.896253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:38.904484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:38.919338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 124/246] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:38.927111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342ab5-0423-4676-94e9-f908c3198614 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:38.936146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:38.937495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.937992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.938456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.940006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:38.942964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4990f8-08bc-4d9d-8ea0-dd079ed57d81 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:38.945020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 123/247] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:38 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:38.950829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:38.958202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d43-6d90-4e48-aa7c-3d26e28901c0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.958652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d43-6d90-4e48-aa7c-3d26e28901c0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.959103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2184d43-6d90-4e48-aa7c-3d26e28901c0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.962551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164da06b-a28b-4f0f-9b05-927fbac049cb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:38.967564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 124/248] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:38.969902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.970342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.970778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.975456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:38.976475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:38.977044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:38.977589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:38.987797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:38.990529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.001364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 125/249] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:39.007758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.014327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:39.016373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:39.020025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fce36-0410-40fc-97a2-441187d97b30 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.025387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.026780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.027380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.027961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.029473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.031016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 125/250] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:39.031668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.037103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.043915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 126/251] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.053449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.067151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98230f49-15b5-442c-8f10-5b4e6debb806 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.072532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.073952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.074213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78699e-2b97-4ad5-9e23-951b3803b890 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.074678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.075214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.076973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.079795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.082983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 126/252] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.088554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.088554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.088554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.088554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.089014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.090002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.091833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.102565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395d782-53cf-4f65-a484-07646bd6f49b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.108303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.109529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.110009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.110515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.133900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 127/253] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:39 2022] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:06:39.135128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.135466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:39.153192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:39.154604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172a83-d9bf-457d-b3e6-ef6f9fc80252 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.156200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 127/254] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:39.166104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.167262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.167765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.168260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.170110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=b3e90558cbbb4b87a2ef481e5f12eadc) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:39.170625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.174121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.174792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.187617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 128/255] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/role_assignments?user.id=b3e90558cbbb4b87a2ef481e5f12eadc&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=6d733f44594041f5bbc6de2766346027 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.201545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ce9a0-ad75-4f84-a5f6-ae111d577b98 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.211130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.212430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.213032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.213606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.215187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:39.215813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.219349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.239178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 128/256] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.249229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.273763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4ebc5-4c45-4dc6-8981-f919a8c07b81 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.282018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.283733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.284872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.289570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] PATH_INFO: `/v3/users/32f9e69a1b3b4329979fd76919a4ab0f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.332424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f9e69a1b3b4329979fd76919a4ab0f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.337581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.341664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 129/257] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/users/32f9e69a1b3b4329979fd76919a4ab0f => generated 297 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.351733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.370257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2dfb08-49a7-4888-8139-c7235fc663aa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.379341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.380994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.381780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.382552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.399841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.403649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.422687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 129/258] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:39.433790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.453061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d53d1-d2f6-4473-98c2-fd0fcb893ac0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.461963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.463981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.464812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.465629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.468297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.473590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6298d4c-82e8-42f9-8b9e-9df250ca1341 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.477625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 130/259] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.487776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.504316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54029805-c1b0-46fc-b0f4-0bc9fd229aff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.512825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.513957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.514442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.514940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.516498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=32f9e69a1b3b4329979fd76919a4ab0f) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:39.517094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.521325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fd35a-979a-4492-acf7-73e8cfc05683 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.532040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 130/260] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/role_assignments?user.id=32f9e69a1b3b4329979fd76919a4ab0f&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=ecbd65ff633045519ad8576a34564b44 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.591591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce69d-5d21-488f-8895-64d9b1b68b7a None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.592099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce69d-5d21-488f-8895-64d9b1b68b7a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.592181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ce69d-5d21-488f-8895-64d9b1b68b7a None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.594478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 131/261] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:39.604992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.605587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.605972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.646242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:39.648444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:39.661742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 131/262] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:39.699108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ce69d-5d21-488f-8895-64d9b1b68b7a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.724824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ce69d-5d21-488f-8895-64d9b1b68b7a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.733023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.734442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.734946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.735438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.759676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:39.780980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:39.783345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 132/263] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:39.791893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.807068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871ddfb-fc0d-4a5f-b200-3a814576d707 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.813691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.816347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.817204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.817955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.819682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:39.820500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.824620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.842585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 132/264] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.851614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.867951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0be67-384a-4ac1-be55-4b40cc09f322 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.878680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.879699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.880079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.880499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] PATH_INFO: `/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.882776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] RBAC: Authorizing `identity:get_user(user_id=b3e90558cbbb4b87a2ef481e5f12eadc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.887277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.889887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 133/265] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/users/b3e90558cbbb4b87a2ef481e5f12eadc => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.896482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.906666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b05ad-0549-4cfc-8c73-fe88403d64a9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.913835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.914494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.914775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.915054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.924370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.927289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.937766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 133/266] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:39.944287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.955524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795d60c-e0bc-4180-9c39-c2656833dde6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.960506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.961435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.961733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.962032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.963339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.965577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3afb-80b4-4f90-ab6a-3db603f361f2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:39.967356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 134/267] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:39.974076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:39.984288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75980bed-bd31-4168-888d-8e536a005a1f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:39.989920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:39.990769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:39.991132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:39.991654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:39.992683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=b3e90558cbbb4b87a2ef481e5f12eadc) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:39.993109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:39.995722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b96997-3212-456e-b22e-67c52a16450b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:40.003873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 134/268] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:39 2022] GET /identity/v3/role_assignments?user.id=b3e90558cbbb4b87a2ef481e5f12eadc&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:40.922529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd5285-a8ad-4e6f-b658-5c6e0876f3d6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:40.923173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd5285-a8ad-4e6f-b658-5c6e0876f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:40.923173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd5285-a8ad-4e6f-b658-5c6e0876f3d6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:40.925265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 135/269] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:40.931837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:40.932407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:40.932643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:40.959434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:40.961197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:40.974941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 135/270] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:41.015830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd5285-a8ad-4e6f-b658-5c6e0876f3d6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.035838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd5285-a8ad-4e6f-b658-5c6e0876f3d6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.042748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.044069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.044554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.045080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.064236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:41.078825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:41.082019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 136/271] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:41.091168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.107970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41164f-a55d-4d6d-b104-3597c2202382 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.116372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.117644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.118140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.118630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.120085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:41.120648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:41.123769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:41.140625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 136/272] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:41.149741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.167150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa35a2d-de97-486a-ac5c-3ed6d7a46043 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.175257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.176624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.177139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.177630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] PATH_INFO: `/v3/users/6f99cfd8f8fa4d7aa5837d356a814446` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.179725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f99cfd8f8fa4d7aa5837d356a814446)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:41.184080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:41.187163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 137/273] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/users/6f99cfd8f8fa4d7aa5837d356a814446 => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:41.198233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.216266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c458c40-66ba-46e1-990c-a166885277f7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.224520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.225704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.226201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.226702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.244125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:41.247674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:41.265546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 137/274] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:41.274501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.292683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8257f7e-6c6a-4eba-9834-c2f7284dcb18 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.301164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.302712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.303204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.303706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.305804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:41.309735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffc009-9240-4ebc-a3c5-2bd7d2ff01c0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:41.313193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 138/275] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:41.323104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:41.340105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460b221-981e-41a3-8d05-d5c3376a9c82 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:41.348643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:41.349784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.350273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.350774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.352380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=6f99cfd8f8fa4d7aa5837d356a814446) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:41.353043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:41.356751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7abbe6-13bd-4b00-9c94-583329a50987 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:41.368923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 138/276] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:41 2022] GET /identity/v3/role_assignments?user.id=6f99cfd8f8fa4d7aa5837d356a814446&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=07cb4a4189484db884216c920f46ba3d => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:41.964280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fc2a8-0870-4be7-bb7c-fea656cfb13a None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.965068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fc2a8-0870-4be7-bb7c-fea656cfb13a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.965068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fc2a8-0870-4be7-bb7c-fea656cfb13a None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.966892 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 139/277] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:41.973354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:41.974083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:41.974083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:41.994158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:41.995367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:42.004520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 139/278] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:42.028397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fc2a8-0870-4be7-bb7c-fea656cfb13a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.042511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fc2a8-0870-4be7-bb7c-fea656cfb13a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.047150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.047957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.048241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.048520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.060685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:42.068453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:42.069964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 140/279] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:42.075834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.085863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376b23f-796b-4b20-a2c5-4b68f77cb5bf None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.090610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.091279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.091557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.091831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.092604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:42.092928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.094589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.105168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 140/280] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:42.111755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.131210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c8c4-746d-4388-a0d2-d3294706cd1a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.138388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.139713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.140109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.140494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] PATH_INFO: `/v3/users/32f9e69a1b3b4329979fd76919a4ab0f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.142620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] RBAC: Authorizing `identity:get_user(user_id=32f9e69a1b3b4329979fd76919a4ab0f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.146769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.152981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 141/281] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/users/32f9e69a1b3b4329979fd76919a4ab0f => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:42.155745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.166743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4d616-6b0f-40d4-ad62-3371c1f53a02 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.171463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.172337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.172590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.172869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.174121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.176787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d7889-9b7b-416d-bf89-7c3e534a449b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.178820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 141/282] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:42.185817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.204315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca31937-c22a-48c2-94cd-869df8d0fdad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.212265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.213953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.214445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.214920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/32f9e69a1b3b4329979fd76919a4ab0f/roles/ecbd65ff633045519ad8576a34564b44` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.218388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, user_id=32f9e69a1b3b4329979fd76919a4ab0f, role_id=ecbd65ff633045519ad8576a34564b44)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.219334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd0bd-7fd9-420d-b0f6-7bf2b5dcd44b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.219617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd0bd-7fd9-420d-b0f6-7bf2b5dcd44b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.219890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cd0bd-7fd9-420d-b0f6-7bf2b5dcd44b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.222403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 142/283] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:42.224312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.227706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.227992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.228277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.246434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 142/284] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:06:42 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/users/32f9e69a1b3b4329979fd76919a4ab0f/roles/ecbd65ff633045519ad8576a34564b44 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:42.254841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:42.256284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:42.332190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 143/285] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:42.357516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.376761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a05d4-5044-4d34-bcd8-87d8aa50fe09 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.385136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.386820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.387312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.387802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.408254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:42.422851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-711fb160-5dc1-4f3b-b756-5ddbc04f5d61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:42.428932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 143/286] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:42.432722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.449358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3e623-72d3-4e92-8ada-e9998b28cc5c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.456583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.457515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.457724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e468-1b26-43a7-ac0a-60d32fc71319 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.457960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e468-1b26-43a7-ac0a-60d32fc71319 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.458060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.458230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e468-1b26-43a7-ac0a-60d32fc71319 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.458407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.459374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:42.459819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.460297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 144/287] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:42.462836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.469057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.469512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.469967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.478391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 144/288] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:42.485223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.495269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:42.496639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:42.497097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae0ca-c50a-4cc8-b9e9-43f1f97e12e8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.502014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.503447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.503937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.504346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] PATH_INFO: `/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.509803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 145/289] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:42.529301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] RBAC: Authorizing `identity:get_user(user_id=72a7b5c1c8424d31b25b45f4fa0d7c55)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.533501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.537388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 145/290] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55 => generated 293 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:42.543866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.547254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.559762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a6be9-67bd-426f-9bfb-87f4f4b1d617 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.562675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80bd3-7d17-4dbc-8ff2-797bd98c7da5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.566920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.567987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.568452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.568911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.570042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.570409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, user.id=72a7b5c1c8424d31b25b45f4fa0d7c55, scope.system=all) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:42.570893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.571261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.571713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.572119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.573957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.574246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ff0ba-31d9-4221-a702-1f31f93b9756 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.576927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.579741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 146/291] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:42.587744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:42.593158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 146/292] 10.222.0.45 () {56 vars in 1329 bytes} [Tue Feb 15 04:06:42 2022] GET /identity/v3/role_assignments?user.id=72a7b5c1c8424d31b25b45f4fa0d7c55&scope.system=all&role.id=07cb4a4189484db884216c920f46ba3d => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:42.599943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbc77d-031c-4de4-a815-19f6fd1c0d52 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:42.605412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:42.606301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:42.606691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:42.607090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:42.607987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:42.610346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c6145-3ea7-41db-b8eb-0da7d91a73b2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:42.638406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 147/293] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:06:42 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:44.978744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb01bd-78b7-4619-a635-d3cb43965758 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:44.979366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb01bd-78b7-4619-a635-d3cb43965758 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:44.979366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb01bd-78b7-4619-a635-d3cb43965758 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:44.981227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 147/294] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:44.987940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:44.988459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:44.988553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.008523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:45.009760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:45.018228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 148/295] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:45.042961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb01bd-78b7-4619-a635-d3cb43965758 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.056582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb01bd-78b7-4619-a635-d3cb43965758 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.061120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.061923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.062208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.062486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.075761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:45.083325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:45.084559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 148/296] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:45.090953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.101341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59429499-bcf9-408f-8611-011a2ed9dfe6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.106214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.106946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.107230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.107506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.108297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:45.108604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.110310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.121633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 149/297] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.128327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.138979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b2db8-3f9f-44c6-aa07-86d3e1193716 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.144086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.144985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.145268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.145542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] PATH_INFO: `/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.146874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] RBAC: Authorizing `identity:get_user(user_id=72a7b5c1c8424d31b25b45f4fa0d7c55)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.149064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e97c1-bc9c-45f0-8805-c871f9d6826d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.150944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 149/298] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.156929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.167862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857cca6-a7d5-4728-a75b-26c82e413b24 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.172825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.174024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.174585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.175093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] PATH_INFO: `/v3/system/users/72a7b5c1c8424d31b25b45f4fa0d7c55/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.176865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=72a7b5c1c8424d31b25b45f4fa0d7c55, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.178158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:45.178158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:45.178158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:45.179405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec108a9d-619b-4c9d-af89-1d75c894f938 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.201191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 150/299] 10.222.0.45 () {58 vars in 1355 bytes} [Tue Feb 15 04:06:45 2022] PUT /identity/v3/system/users/72a7b5c1c8424d31b25b45f4fa0d7c55/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:45.210440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162871e-fe30-47c7-afd7-74cb02dcfe6e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.210706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162871e-fe30-47c7-afd7-74cb02dcfe6e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.210991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162871e-fe30-47c7-afd7-74cb02dcfe6e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.212829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 150/300] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:45.218810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.219137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.219372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.229354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2002089-63a9-40a8-8663-3c5e4a504e06 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.229537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2002089-63a9-40a8-8663-3c5e4a504e06 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.229807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2002089-63a9-40a8-8663-3c5e4a504e06 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.231669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 151/301] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:45.238595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.238911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.239191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.240604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:45.242085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:45.250466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 151/302] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:45.263551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:45.264779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:45.273895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 152/303] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:45.278856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.289231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254a45d-de5f-4d06-b4bc-c84c9bb61a80 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.294027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.294885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.295167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.295443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.296738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.298741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.298973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.301661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 152/304] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.308678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.310732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aa824-e96a-4980-a528-0d3e876ca10c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.316809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.317681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.317998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.318249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.320747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3858a92-e897-4cd0-b889-8afcca32b73c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.326069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.326769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.327053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.327328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] PATH_INFO: `/v3/groups` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.328037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.329115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:45.329115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:45.329115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:45.330250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:45.330388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.339108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-58e0d6cc-4ee3-4ace-8c0f-4d33411d5212 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:45.345538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 153/305] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:45.348002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61c29-c4af-4e37-8013-ca3e9fdcc405 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.348253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 153/306] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:06:45 2022] POST /identity/v3/groups => generated 229 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:45.348579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61c29-c4af-4e37-8013-ca3e9fdcc405 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.348862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61c29-c4af-4e37-8013-ca3e9fdcc405 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.350903 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 154/307] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:45.355504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.357526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.360939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.360939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.369514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634a0d1-1870-4eb6-9004-7520111d7d48 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.376261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.378235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.378877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.379380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.380841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:45.381453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.383347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.384809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:45.386604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:45.395521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 154/308] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.401095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 155/309] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:45.402915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.417528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c3053-689d-4477-861e-8954206a8325 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.422151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.424500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.424500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.424500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] PATH_INFO: `/v3/users/e8c3001c44274ac28c94da876d480d67` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.425343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.434828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3491e182-04f3-4e84-9ee6-8e6cf14bd836 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.440851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.441792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.442151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.442435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.443748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8c3001c44274ac28c94da876d480d67)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.446293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.448947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 155/310] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/users/e8c3001c44274ac28c94da876d480d67 => generated 293 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.455468 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.458772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:45.467195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:45.467936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9f31b-be89-4390-bf4b-ceaaf629e279 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.468842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 156/311] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:45.475821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.478794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.479531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.479852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.480167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.481088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, user.id=e8c3001c44274ac28c94da876d480d67, scope.system=all) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:45.481488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.484781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.487677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849be662-1e0e-45da-ae11-8cfdeb57f315 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.492809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.493664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.494112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.494332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 156/312] 10.222.0.45 () {56 vars in 1329 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/role_assignments?user.id=e8c3001c44274ac28c94da876d480d67&scope.system=all&role.id=ecbd65ff633045519ad8576a34564b44 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.494644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.495669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:45.496057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.497897 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.516202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 157/313] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:45.517719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.529239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739564b-d1ce-497c-9166-2feda31b4b39 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.534375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.535425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.535710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.535988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] PATH_INFO: `/v3/users/32f9e69a1b3b4329979fd76919a4ab0f` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.537504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] RBAC: Authorizing `identity:get_user(user_id=32f9e69a1b3b4329979fd76919a4ab0f)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.539905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.541851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 157/314] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/users/32f9e69a1b3b4329979fd76919a4ab0f => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.547701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.559032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b14141-8412-40f5-97cd-91e240f1cb84 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.563812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.564488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.564816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.565168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.574460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.576252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.588852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 158/315] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:45.593909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.605759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d2b64-f4cf-4d2a-80f3-7244d1bb0a36 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.615091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.616345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.616843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.617488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.619074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.621476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a3b4e-19be-4aca-9769-afd6ef7802e7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.623495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 158/316] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:45.629839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:45.639799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed6067-a85a-4c66-bd39-62e6f3cb75df admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:45.645758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:45.646525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:45.647027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:45.647315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:45.648210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, scope.project.id=5ca0acba1d004a8e8a1235577db30c69, user.id=32f9e69a1b3b4329979fd76919a4ab0f) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:45.648525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:45.650549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690e909-4136-43f7-bb9c-5dfb9d4ec855 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:45.657733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 159/317] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:06:45 2022] GET /identity/v3/role_assignments?user.id=32f9e69a1b3b4329979fd76919a4ab0f&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=ecbd65ff633045519ad8576a34564b44 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:47.669751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928db0-8a5f-4351-80b8-b5c2e904c5e0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.670497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928db0-8a5f-4351-80b8-b5c2e904c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.670497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b928db0-8a5f-4351-80b8-b5c2e904c5e0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.672044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 159/318] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:47.679719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.680231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.680528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.701331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:47.702545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:47.711451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 160/319] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:47.736122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b928db0-8a5f-4351-80b8-b5c2e904c5e0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.761641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b928db0-8a5f-4351-80b8-b5c2e904c5e0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.769203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.770508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.771006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.771608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.790935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:47.805392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-48955efa-068c-49b9-b772-f4e0812437e6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:47.807809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 160/320] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:47.817688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.831576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da424d-b685-4d9a-8001-b25335e18161 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.839149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.840139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bce0b-df0e-4dd6-906e-2d6b3aac2440 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.840335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.840458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bce0b-df0e-4dd6-906e-2d6b3aac2440 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.840718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.840855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bce0b-df0e-4dd6-906e-2d6b3aac2440 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.841188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.842781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:47.842950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 161/321] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:47.843077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:47.845858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d14de5-1a98-45cc-8a89-f2d9bde0152b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:47.848545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb2bc-e500-4462-9d71-90797e2f312a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.848879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb2bc-e500-4462-9d71-90797e2f312a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.849191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cb2bc-e500-4462-9d71-90797e2f312a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.861563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 161/322] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:47.864866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922be7d-ca8b-4ffb-95c7-7943eba728e1 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.865377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922be7d-ca8b-4ffb-95c7-7943eba728e1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.865854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922be7d-ca8b-4ffb-95c7-7943eba728e1 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.869267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-426cb2bc-e500-4462-9d71-90797e2f312a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:47.870086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 162/323] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:47.871456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-426cb2bc-e500-4462-9d71-90797e2f312a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:47.871635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922be7d-ca8b-4ffb-95c7-7943eba728e1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.880721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 162/324] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:47.882311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.882859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.883139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.892485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922be7d-ca8b-4ffb-95c7-7943eba728e1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.900223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.901770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.902261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.902748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] PATH_INFO: `/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.905157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] RBAC: Authorizing `identity:get_user(user_id=72a7b5c1c8424d31b25b45f4fa0d7c55)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:47.909853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:47.913029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 163/325] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/users/72a7b5c1c8424d31b25b45f4fa0d7c55 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:47.917236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:47.919018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:47.919417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.927866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 163/326] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:47.928691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.937589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd471-6ab0-443b-a428-3485e4ba435a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.938262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae5348-7b56-49b0-875a-3558d8bf9675 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.943036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.943875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.944178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.944434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.945732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:47.946058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.947192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.947524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:47.947671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.948171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.949477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 164/327] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:47.949772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] RBAC: Adding query filter params (role.id=07cb4a4189484db884216c920f46ba3d, user.id=72a7b5c1c8424d31b25b45f4fa0d7c55, scope.system=all) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:47.950317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:47.954022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:47.954783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.964666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d30fa-a570-4f35-9e5a-e4a2798b3204 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:47.969433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:47.970096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:47.970375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:47.970649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] PATH_INFO: `/v3/groups` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:47.971882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:47.973861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:47.977251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 164/328] 10.222.0.45 () {56 vars in 1329 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/role_assignments?user.id=72a7b5c1c8424d31b25b45f4fa0d7c55&scope.system=all&role.id=07cb4a4189484db884216c920f46ba3d => generated 510 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:47.986952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:47.992663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 165/329] 10.222.0.45 () {60 vars in 1155 bytes} [Tue Feb 15 04:06:47 2022] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:06:47.994893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6a967-c7e7-460a-b6a8-9c7cf73e40c2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:48.002328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:48.004990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:48.005384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:48.005747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:48.026669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:48.039514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:48.041793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 165/330] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:48.050868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:48.070208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeb470-6458-4637-bb3c-ce4fe9205851 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:48.078272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:48.079812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:48.080506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:48.081713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:48.083457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:48.084151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:48.087449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:48.105164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 166/331] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:48.114360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:48.131950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b18c6-4e78-406c-98a6-340479923722 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:48.139856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:48.141559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:48.142152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:48.142719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] PATH_INFO: `/v3/users/e8c3001c44274ac28c94da876d480d67` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:48.145902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] RBAC: Authorizing `identity:get_user(user_id=e8c3001c44274ac28c94da876d480d67)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:48.150213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075cb6a-0dfb-4702-bc93-1012deeca4be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:48.156940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 166/332] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:48 2022] GET /identity/v3/users/e8c3001c44274ac28c94da876d480d67 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:48.164220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:48.181034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6839-0135-455a-a20b-174bbe4449cb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:48.187732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:48.188738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:48.189231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:48.189621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] PATH_INFO: `/v3/system/users/e8c3001c44274ac28c94da876d480d67/roles/ecbd65ff633045519ad8576a34564b44` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:48.192183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8c3001c44274ac28c94da876d480d67, role_id=ecbd65ff633045519ad8576a34564b44)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:48.194330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f0fee2-9ce8-4425-8459-71723270a251 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:48.205077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 167/333] 10.222.0.45 () {58 vars in 1355 bytes} [Tue Feb 15 04:06:48 2022] PUT /identity/v3/system/users/e8c3001c44274ac28c94da876d480d67/roles/ecbd65ff633045519ad8576a34564b44 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:06:52.216135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd3c1-31f8-4bfd-816e-26887c5c7b15 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.217493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd3c1-31f8-4bfd-816e-26887c5c7b15 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.218223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd3c1-31f8-4bfd-816e-26887c5c7b15 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.223315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 167/334] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:52.231205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.231955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.231955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.262146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:52.263364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:52.273134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 168/335] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:52.336419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedd3c1-31f8-4bfd-816e-26887c5c7b15 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.362514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedd3c1-31f8-4bfd-816e-26887c5c7b15 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.370729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.372512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.373326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.374094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.406491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:52.421917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:52.429806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 168/336] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:52.437960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.453180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd169-c5b8-441d-b4b1-ceeab874178f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.466768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.467369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.467646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.467917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.468684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:52.469010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.470649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693370c-3d94-47b5-b067-352a97d4d634 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.483767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 169/337] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:52.491290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.516948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cafb5-a83f-46b2-8de5-b8cc04d4bea8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.523815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c75679-f1bd-4ad0-8496-c0695fe34516 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.524105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c75679-f1bd-4ad0-8496-c0695fe34516 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.524438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c75679-f1bd-4ad0-8496-c0695fe34516 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.526249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 170/338] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:06:52.530418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.532104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.532961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.534445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.542954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.543339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.543485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.555826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.559642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.576184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:52.577427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:52.582042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 169/339] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:52.590064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.591972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 171/340] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:52.609860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1875189-3078-44e0-b362-4d270d2283b2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.623723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.625149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.625625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.626105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.628820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.632813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.634903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.636357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 170/341] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.650522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.654521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12761687-293a-49a9-baa3-110373b6bc4e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.669674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.670495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.670787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.671033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.672092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2307-b042-417c-96cd-603d9dd56343 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.680650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.682124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.682630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.683128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.685865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:52.693881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-c6344857-0d0f-4e7d-b0ea-eec52287f5d5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:52.694427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.695442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 172/342] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:52.696288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:52.696288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:06:52.696288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:06:52.696984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2cdf9-c998-46ae-83e4-4867d0c628d4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.697238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2cdf9-c998-46ae-83e4-4867d0c628d4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.697471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2cdf9-c998-46ae-83e4-4867d0c628d4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.698652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03079988-fe0e-4294-b62a-1eeb19ef3997 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.698969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 173/343] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:52.702153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 171/344] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.706838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2cdf9-c998-46ae-83e4-4867d0c628d4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.707801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.708296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.708783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.741510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2cdf9-c998-46ae-83e4-4867d0c628d4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.753236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.753236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.753236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.753236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.753875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:52.753875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.754333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.760949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:52.760949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:52.772451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 174/345] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.773108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.788100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2bee-7068-4746-99be-eb2fa88643c3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.791372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 172/346] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:52.791994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.803894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.804569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.804847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.805160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.806008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=2a1c6b544b404e63a97221c73a9ace10) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:52.806314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.808212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.817381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f80d9d-b166-4f26-bec4-5f901ff773a0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.821863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 175/347] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=07cb4a4189484db884216c920f46ba3d => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.831793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.832485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.832769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.833155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.845347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.847929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.857422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.870051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d35bd5-f709-40eb-8d01-7d24ec218af1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.879728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 173/348] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:52.883308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.885347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.889769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.890186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.890465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.908331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c492-d538-434e-b15a-dea218ba475c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.917340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:52.924817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 15 04:06:52.928319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 176/349] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:52.934662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.935569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.935845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.936099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.937489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.939564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.943598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.944274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 174/350] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.950630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:52.971467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8c78-e934-40ad-abb0-5f37fefb6954 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.975520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a8d9-4ebf-4bb0-95d4-11fb8bf0ac8d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:52.981885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.982551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.982813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.983084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.983912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:52.984154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.985783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:52.987461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:52.989071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:52.989457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:52.989929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:52.992046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:52.996603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 177/351] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:52.998286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.000316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 175/352] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:52 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:53.005747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.007073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.027058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4002c31-a604-473f-9100-883e8997d683 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.034309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e8488-6555-47b8-b3a3-675d8a3a4998 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.040281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.041166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.041499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.041725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] PATH_INFO: `/v3/users/e8c3001c44274ac28c94da876d480d67` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.043436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8c3001c44274ac28c94da876d480d67)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.045679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.047445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 178/353] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/users/e8c3001c44274ac28c94da876d480d67 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:53.051436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.052116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.052401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.052659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.053536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=2a1c6b544b404e63a97221c73a9ace10) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:53.053839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.055711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00746068-02dc-4738-a517-016bc9160588 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.058566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.075717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 176/354] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=6d733f44594041f5bbc6de2766346027 => generated 260 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:53.078101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e4327-ecf6-416c-a30b-45a3ad664316 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.084396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.085101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.085364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.085645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.086522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] RBAC: Adding query filter params (role.id=ecbd65ff633045519ad8576a34564b44, user.id=e8c3001c44274ac28c94da876d480d67, scope.system=all) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:53.086829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.088981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9dd4f-7114-44df-b9f7-ff682f22d8ea admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.114563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 179/355] 10.222.0.45 () {56 vars in 1329 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/role_assignments?user.id=e8c3001c44274ac28c94da876d480d67&scope.system=all&role.id=ecbd65ff633045519ad8576a34564b44 => generated 510 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:53.239522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462b57-082e-40b3-9df9-ba37d6dbae8a None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.240563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462b57-082e-40b3-9df9-ba37d6dbae8a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.240563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462b57-082e-40b3-9df9-ba37d6dbae8a None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.242234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 177/356] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:53.248112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.249032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.249032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.277847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:53.279068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:53.293100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 180/357] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:53.339243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462b57-082e-40b3-9df9-ba37d6dbae8a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.373144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462b57-082e-40b3-9df9-ba37d6dbae8a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.386043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.387463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.388024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.388523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.414006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:53.433167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:53.435836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 178/358] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:53.443517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.455818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d2b95-940d-46a0-a34f-fbd31a800e08 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.464509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.465217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.465474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.465750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.466521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:53.466822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.468504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.483026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 181/359] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:53.490034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.515508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17276029-5499-4813-85e7-41a13448c4a1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.530309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.531560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.532052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.532561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.557311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.560695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.582860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 179/360] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:53.588485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.605702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05472856-94d0-4454-9333-4ed6f0a7ba7f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.618082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.618952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.619230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.619504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.625915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.628474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.630677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 182/361] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:53.637321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.661112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c734f6-e138-44d4-b460-8bdb68325614 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.669944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.671502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.671994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.672476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.675562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.679524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81327d6f-59b0-4305-8d68-996fd99c1d73 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.683295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 180/362] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:53.688884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:53.704911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32877e78-0474-44a7-abd7-86cc12a79b40 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:53.714353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:53.715068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:53.715346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:53.715678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:53.716526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=5ca0acba1d004a8e8a1235577db30c69) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:53.724843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:53.724843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef7110-0f8f-49ff-9aaf-37a8f849f234 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:53.733550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 183/363] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:06:53 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=07cb4a4189484db884216c920f46ba3d => generated 260 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:54.459553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c069-4fc5-41cd-95fc-f6b99bb5381f None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.461122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c069-4fc5-41cd-95fc-f6b99bb5381f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.461901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2c069-4fc5-41cd-95fc-f6b99bb5381f None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.465951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 181/364] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:54.474116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.474867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.474867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.501366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:54.503162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:54.516036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 184/365] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:54.565576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2c069-4fc5-41cd-95fc-f6b99bb5381f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.598950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2c069-4fc5-41cd-95fc-f6b99bb5381f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.610013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.611738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.612557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.613584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.642731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:54.662429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:54.665617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 182/366] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:54.674625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.691620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b0f8c-c777-4cc2-ac6c-46b835274244 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.700930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.701614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.701904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.702171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.702944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:54.703250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:54.704873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:54.720956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 185/367] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:54.730868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.767594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfab69c-cd50-4290-8e95-d21139f1fad8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.782129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.784292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.787624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.788640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.808856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:54.812730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:54.834258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 183/368] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:06:54.842773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.864049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce157fa5-ab01-412c-a6ac-d8fa1fa8aade admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.879838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.880723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.881033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.881328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.882594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:54.884718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:54.886802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 186/369] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:54.897358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.918776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4309a-3045-4bad-8959-ba687704cbf7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.929458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.930345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.930626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.930901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.937804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:54.940609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a46a311-b051-4cb4-807b-eef7e0a99c54 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:54.942072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 184/370] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:54.951216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:54.961815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9cce6-5250-42f8-866e-306f5ca293eb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:54.969363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:54.970029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:54.970314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:54.970592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:54.972407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=5ca0acba1d004a8e8a1235577db30c69) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:54.972672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:54.974562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6bda-2f7f-4dbd-9ac2-60da326dc6c3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:54.986217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 187/371] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:06:54 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=6d733f44594041f5bbc6de2766346027 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:55.419207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a968-7c23-4cf1-b606-ad31ef6ee1ef None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.419207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a968-7c23-4cf1-b606-ad31ef6ee1ef None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.419207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a968-7c23-4cf1-b606-ad31ef6ee1ef None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.419782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 185/372] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:55.430555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.431239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.431860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.454789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:55.456610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:55.467679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 188/373] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:55.525545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a968-7c23-4cf1-b606-ad31ef6ee1ef None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.543610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a968-7c23-4cf1-b606-ad31ef6ee1ef None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.551932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.553158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.553643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.554195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.572556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:55.584038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:06:55.586069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 186/374] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:55.592222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.611766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da357d7f-0b56-4122-99cb-511cc934bc1b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.621110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.621802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.622085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.622360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.623209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:55.623519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:55.625251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:55.642328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 189/375] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:55.648477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.663557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4e64a-a737-4b15-bd77-f0bbc5d7d8d4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.673079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.674194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.674767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.675539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.690543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:55.693584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:55.707525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 187/376] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:06:55.713692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.731647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c266ab-b464-4792-a5bd-22a420e181ec admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.746740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.747639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.747917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.748196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] PATH_INFO: `/v3/projects/14db3a76771b4984aca50bf3056efc27` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.749559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] RBAC: Authorizing `identity:get_project(project_id=14db3a76771b4984aca50bf3056efc27)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:55.751409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:55.755097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 190/377] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/projects/14db3a76771b4984aca50bf3056efc27 => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:55.759322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.779685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55f24b-3f3e-49d7-b2b8-e991ce9eeb37 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.786586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.787896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.788406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.788877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] PATH_INFO: `/v3/groups/5c27cc940fd44ca2a925075eeb1eded5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.799795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] RBAC: Authorizing `identity:get_group(group_id=5c27cc940fd44ca2a925075eeb1eded5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:55.804049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b43d0-414a-4221-bb18-34b730448371 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:55.806725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 188/378] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/groups/5c27cc940fd44ca2a925075eeb1eded5 => generated 229 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:55.812880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:55.828635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d25a3e-53fa-4e35-9657-56877d3ea008 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:55.837310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:55.837978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:55.838262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:55.838539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:55.839398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] RBAC: Adding query filter params (group.id=5c27cc940fd44ca2a925075eeb1eded5, role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=14db3a76771b4984aca50bf3056efc27) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:55.839708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:55.841624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0f991-5675-419a-a8f3-dd2bc9274b23 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:55.853809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 191/379] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:06:55 2022] GET /identity/v3/role_assignments?group.id=5c27cc940fd44ca2a925075eeb1eded5&scope.project.id=14db3a76771b4984aca50bf3056efc27&role.id=3e51986d5b3b4564805a85330713b776 => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:56.459223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c38eba-ba38-46af-b32f-509e4d21df79 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.459884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c38eba-ba38-46af-b32f-509e4d21df79 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.460392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c38eba-ba38-46af-b32f-509e4d21df79 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.462706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 189/380] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:56.480144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.480758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.481281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.506738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:56.508278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:56.536487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 192/381] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:06:56.605177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c38eba-ba38-46af-b32f-509e4d21df79 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:56.634686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c38eba-ba38-46af-b32f-509e4d21df79 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:56.647006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:56.648228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.648707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.649200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.674605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:56.682447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:56.684339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 190/382] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:56.693632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:56.709479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc6854-5a32-47c6-a84a-38890d415170 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:56.738615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:56.739984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.740449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.740876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.742226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:56.742717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:56.761900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:56.776887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 193/383] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:56.786063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:56.816422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2679ea-b041-4935-847b-f0adf6c7d2f8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:56.843894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:56.845165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.845675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.846705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.854424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:56.857475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686df35d-292e-406a-8ba1-245d10b48786 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:56.861406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 191/384] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:56 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:56.870658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:56.904943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cee72-c36b-4294-8b41-eb6b09c39b3f None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.904943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cee72-c36b-4294-8b41-eb6b09c39b3f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.904943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cee72-c36b-4294-8b41-eb6b09c39b3f None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.905263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34570299-a0fe-47cc-96ea-70ce0118d847 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:56.906944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 192/385] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:56.919154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.919664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.920165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.938252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:56.940154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:56.941511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:56.941511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:56.949554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:56.953380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:56.957185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 194/386] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:56 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:56.966474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:56.992942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:57.004929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:57.005127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494017-6105-4b85-a616-4c16d48e4848 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.036405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 193/387] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:57.040928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.040928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.040928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.041269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/groups/1dab1e638f3548658ba3c37c7654b38b/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.053681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, group_id=1dab1e638f3548658ba3c37c7654b38b, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:57.058529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:57.117117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 195/388] 10.222.0.45 () {58 vars in 1463 bytes} [Tue Feb 15 04:06:56 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/groups/1dab1e638f3548658ba3c37c7654b38b/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:57.165718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:57.193567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df39e5-43ca-4114-8b41-3f0259d2727a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.327739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.329041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.329508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.329971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.356343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:57.372187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:06:57.378907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 194/389] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:06:57.387449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:57.411175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdec07-d373-44a7-8f89-e45529fd8c4f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.420185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.420875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.421196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.421470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.422246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:57.422525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:57.424216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:57.434828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 196/390] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:57.446128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:57.466879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ba610-f190-486a-ac9c-49305c0fc7c8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.475668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.480025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.480885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.481642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.484129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:57.488054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:57.491992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 195/391] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:57 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:57.500299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:57.514629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557ddf6-d4bc-4cd3-9924-1084cc54957d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.521531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.522406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.522684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.522970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.524247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:57.526379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16772-69b8-4725-a92d-cd25baffa41c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:57.528370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 197/392] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:57 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:57.538018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:57.559373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f781a3-6feb-4b72-a40a-96ad642252d6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:57.567098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:57.569033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:57.569788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:57.570485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10/groups/1dab1e638f3548658ba3c37c7654b38b/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:57.574507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1c6b544b404e63a97221c73a9ace10, group_id=1dab1e638f3548658ba3c37c7654b38b, role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:57.579308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d569f5-de71-4698-9a0d-f5a29327b575 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:57.612404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 196/393] 10.222.0.45 () {58 vars in 1463 bytes} [Tue Feb 15 04:06:57 2022] PUT /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10/groups/1dab1e638f3548658ba3c37c7654b38b/roles/6d733f44594041f5bbc6de2766346027 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:58.828525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5532a-15c7-46bb-959f-fe966f68af9b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:58.829532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5532a-15c7-46bb-959f-fe966f68af9b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:58.829532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5532a-15c7-46bb-959f-fe966f68af9b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:58.834766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 198/394] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:58.840448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:58.841932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:58.842696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:58.881411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:58.883906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:06:58.997808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 197/395] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:06:59.042313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5532a-15c7-46bb-959f-fe966f68af9b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:59.071187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5532a-15c7-46bb-959f-fe966f68af9b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:59.083596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:59.085625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.086381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.087118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.118085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:06:59.139752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:06:59.142910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 199/396] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:06:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:06:59.149390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:59.163637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891ffe-bd40-4e8f-9567-8442eb3e71d3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:59.169167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:59.169884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.170167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.170443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.171241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:06:59.171543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:59.175904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:59.188218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 198/397] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:06:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:06:59.195466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:59.218198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c8a2b-09fa-4610-8b4a-8acd21fcba19 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:59.226734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:59.228633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.229462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.230242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.237068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:59.239707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:06:59.239707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:06:59.239707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:06:59.242919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:59.246818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 200/398] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:06:59 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:59.252928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:59.267747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ba867-f050-4429-b855-467bbcafe812 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:59.286556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:59.287481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.287764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.288041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.293986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:59.296185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117d0e5-d529-471c-a13d-6e1456a567a5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:59.298458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 199/399] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:06:59 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:06:59.305305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:06:59.330871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69ec0-2bfc-4d29-8e2d-ba7d9862512d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:06:59.339457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:06:59.341757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.342671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.343541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/groups/1dab1e638f3548658ba3c37c7654b38b/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.351400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, group_id=1dab1e638f3548658ba3c37c7654b38b, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:06:59.357636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676de32-99ba-4059-aa33-583d07c10e11 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:06:59.399873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 201/400] 10.222.0.45 () {58 vars in 1463 bytes} [Tue Feb 15 04:06:59 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/groups/1dab1e638f3548658ba3c37c7654b38b/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:06:59.836217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee7e2-c3b3-42a8-8f0d-473a108b28e6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.837293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee7e2-c3b3-42a8-8f0d-473a108b28e6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.838103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ee7e2-c3b3-42a8-8f0d-473a108b28e6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.842387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 200/401] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:06:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:06:59.850206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:06:59.851628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:06:59.852415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:06:59.889241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:06:59.891819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:00.038473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 202/402] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:06:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:00.089373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ee7e2-c3b3-42a8-8f0d-473a108b28e6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.112318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ee7e2-c3b3-42a8-8f0d-473a108b28e6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.120610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.122660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.123573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.124332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.149963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:00.169023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-aaf5b11c-9a2b-4562-921c-c79556b1f63c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:07:00.172141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 201/403] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:00.181527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.206926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa1c8-dfc4-40a7-bd4b-6be0d0dbc19c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.207593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458195b-5123-4933-b3a7-1e9ea24d644c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.208098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa1c8-dfc4-40a7-bd4b-6be0d0dbc19c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.209024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa1c8-dfc4-40a7-bd4b-6be0d0dbc19c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.212645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 202/404] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:00.223994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.225152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.225610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.226081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.227447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:00.227972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.230904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.238596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.239519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.240284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.258891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 203/405] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:00.268337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.279241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:00.281758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:00.296836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b20f2-1458-4e9d-a03d-004afcd0ab79 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.297968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 203/406] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:00.313119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.314772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.315249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.315769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.322477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.326402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.330048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 204/407] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:00.339080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.362813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9b4bd-d7ba-4458-be1f-b6b87f5a380e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.363598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.371311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.373226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.373929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.374641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.377220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.382222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.386520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 204/408] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:00.386969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f10f5a-f305-4836-984a-89d14bf79872 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.394323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.403846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.404955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.405422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.405885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.415654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27e9fb-6477-4038-9df1-644153055ad2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.424733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.427040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.427981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.428775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69/groups/1dab1e638f3548658ba3c37c7654b38b/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.433178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca0acba1d004a8e8a1235577db30c69, group_id=1dab1e638f3548658ba3c37c7654b38b, role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.438656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.449787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:00.460119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:00.461913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 205/409] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:00.464697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 205/410] 10.222.0.45 () {58 vars in 1463 bytes} [Tue Feb 15 04:07:00 2022] PUT /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69/groups/1dab1e638f3548658ba3c37c7654b38b/roles/6d733f44594041f5bbc6de2766346027 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:00.468847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.492665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125982-02c3-45f0-b918-12b07243ba4a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.605355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.606944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.607636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.608262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.610767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:00.612654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.615979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.633182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 206/411] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:00.642461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.660553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7840920-e809-4785-8a0a-9b41d1cd0c97 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.671488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.673246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.673937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.675052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] PATH_INFO: `/v3/groups/5c27cc940fd44ca2a925075eeb1eded5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.677477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] RBAC: Authorizing `identity:get_group(group_id=5c27cc940fd44ca2a925075eeb1eded5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.681130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.684794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 206/412] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/groups/5c27cc940fd44ca2a925075eeb1eded5 => generated 229 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:00.690773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.714445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c3a68-3048-460f-86e0-4d55615566d7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.724361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.726254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.726971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.727712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] PATH_INFO: `/v3/projects/14db3a76771b4984aca50bf3056efc27` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.734770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=14db3a76771b4984aca50bf3056efc27)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.739536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d5fc8-679d-4adc-9f70-b7374d5859e2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.743345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 207/413] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:00 2022] GET /identity/v3/projects/14db3a76771b4984aca50bf3056efc27 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:00.755504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:00.778437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adee32-b43a-4bf9-a6bd-7b9b465ebffe admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:00.788196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:00.790282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:00.791066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:00.791780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] PATH_INFO: `/v3/projects/14db3a76771b4984aca50bf3056efc27/groups/5c27cc940fd44ca2a925075eeb1eded5/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:00.796315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14db3a76771b4984aca50bf3056efc27, group_id=5c27cc940fd44ca2a925075eeb1eded5, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:00.803185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f105193-a041-4142-9692-ba01d9612485 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:00.839773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 207/414] 10.222.0.45 () {58 vars in 1463 bytes} [Tue Feb 15 04:07:00 2022] PUT /identity/v3/projects/14db3a76771b4984aca50bf3056efc27/groups/5c27cc940fd44ca2a925075eeb1eded5/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:01.301331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e287-4e57-4901-b37c-635c63e82bdc None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.301852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e287-4e57-4901-b37c-635c63e82bdc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.301928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62e287-4e57-4901-b37c-635c63e82bdc None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.304477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 208/415] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:01.311099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.312099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.312592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.337187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:01.338838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:01.413782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 208/416] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:01.460386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e287-4e57-4901-b37c-635c63e82bdc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.481032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62e287-4e57-4901-b37c-635c63e82bdc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.490180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.490987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.491276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.491549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.507797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:01.514998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:07:01.521273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 209/417] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:01.522633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.539213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf6c88-4c5e-47d9-bdcd-23516e8f988d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.548488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.550105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.550628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.551134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.552174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:01.552692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.554558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.564183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 209/418] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:01.570597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.585011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002dd078-6c2c-4094-859f-8435576e2f07 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.590046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.591070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.591605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.592133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.605050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.607377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.623034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 210/419] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:01.629320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.643701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939acb5-2d02-44bd-af95-3145f65187fc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.649085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.650349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.650860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.651356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.652866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.655235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1face7a4-70f9-4433-a5fa-6699b6082a35 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.661145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 210/420] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:01.663882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.668065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de30bd-49a0-4f68-b7f2-ebf3a2484911 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.668353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de30bd-49a0-4f68-b7f2-ebf3a2484911 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.668634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de30bd-49a0-4f68-b7f2-ebf3a2484911 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.670600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 211/421] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:01.675077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532de69a-15bf-4882-a972-5d9673b67b5f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.677722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.678009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.678286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.683014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.684299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.684808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.685327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.686880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.689053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.691290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 211/422] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:01.697358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.709669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1593bef-a5df-41ec-b3a0-ca6b0440a73d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.710028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:01.711265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:01.716842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.718497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.719250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.720041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.722456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=2a1c6b544b404e63a97221c73a9ace10) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:01.723049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.725766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.735807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 212/423] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=07cb4a4189484db884216c920f46ba3d => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:01.743496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 212/424] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:01.791241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.811874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af5a1a-df50-412e-82d6-c062bddd8ed5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.819639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.826668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.827527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.828260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.847208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:01.862837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:07:01.865339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 213/425] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:01.871011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.887875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee1995d-7a19-43ec-ae2d-67e1d73f032e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.900974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.901683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.901965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.902241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.903027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:01.903404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.904992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:01.925574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 213/426] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:01.931078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:01.953937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fc901-79c6-41ce-b6ff-126dd3ed1b86 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:01.962626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:01.964329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:01.965139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:01.965948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:01.987738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:01.991512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:02.014805 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 214/427] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:02.020568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:02.038632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1db69-6331-4ce2-8ab6-944ab7709fe8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:02.054371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:02.055313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:02.055604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:02.055881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] PATH_INFO: `/v3/projects/2a1c6b544b404e63a97221c73a9ace10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:02.057197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] RBAC: Authorizing `identity:get_project(project_id=2a1c6b544b404e63a97221c73a9ace10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:02.059269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:02.061361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 214/428] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:02 2022] GET /identity/v3/projects/2a1c6b544b404e63a97221c73a9ace10 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:02.068103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:02.088300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8788f532-9aec-4584-873a-328b42876e16 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:02.100374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:02.101808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:02.102276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:02.102730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:02.104920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:02.108209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae8e1c-0f07-454e-90e0-928ed7b8b0d7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:02.113179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 215/429] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:02 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:02.118896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:02.133156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051696a-35bd-4332-a0da-27c133a81c6c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:02.142506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:02.143994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:02.144530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:02.145119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:02.146658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=2a1c6b544b404e63a97221c73a9ace10) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:02.147259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:02.150698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0529a-7129-4017-bc15-1ec4cb2f78af admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:02.168111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 215/430] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:07:02 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=2a1c6b544b404e63a97221c73a9ace10&role.id=6d733f44594041f5bbc6de2766346027 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:03.474124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512949-0931-4276-ab1b-d398995cec12 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.475672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512949-0931-4276-ab1b-d398995cec12 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.476447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7512949-0931-4276-ab1b-d398995cec12 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.480008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 216/431] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:03.486890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792af2f-1fb2-4768-b8f7-6ae7eb06aebc None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.487693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792af2f-1fb2-4768-b8f7-6ae7eb06aebc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.487693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792af2f-1fb2-4768-b8f7-6ae7eb06aebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.508751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c792af2f-1fb2-4768-b8f7-6ae7eb06aebc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:03.510032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c792af2f-1fb2-4768-b8f7-6ae7eb06aebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:03.519671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 216/432] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:03.545074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7512949-0931-4276-ab1b-d398995cec12 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.567768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7512949-0931-4276-ab1b-d398995cec12 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.568082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fb68-2237-4abb-a076-f9008d68c752 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.568364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fb68-2237-4abb-a076-f9008d68c752 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.568644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fb68-2237-4abb-a076-f9008d68c752 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.570453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 217/433] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:03.575120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.575673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.575966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.576239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.576564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.577100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.577601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.595156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:03.596684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:03.598922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:03.604714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 218/434] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:03.612173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:07:03.618700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 217/435] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:03.620350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.629737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.631192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dd230-77d3-41d7-8ea8-7184d2a42689 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.635797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.636473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.636755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.637066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.637831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:03.638134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.639994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.647304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d6384-5a48-4d5f-a444-1e7af955b431 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.653213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 219/436] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.654363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.655194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.655700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.656168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.656628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.665784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1c051c-7c81-4e0c-b6a3-71d5e152ca4a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.670452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.671295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.671578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.672214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.676470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:03.681337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.683105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.683666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 15 04:07:03.685202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 218/437] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:03.692309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.694031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 220/438] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:03.699375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.708164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15d924-8af9-4e6e-a7f9-7985a5796ac2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.709592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29064-01f9-4963-831e-822f04b0a1f8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.712545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.713512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.713796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.714073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.715254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.716646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.720086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.720220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.720220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.720220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.720397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 221/439] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.720461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:03.720682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.725267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.725946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.735402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459496f-b50a-4d18-b28b-5dac42b10540 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.744634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.744827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 219/440] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.744945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.744945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.744945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.744945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.745391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.748802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.751904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 222/441] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.753384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.763506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173677e8-5022-40c1-86aa-e5655c590cc3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.763745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c633a8f-9b2d-432f-92bf-716da5eadbad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.768591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.768784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.769291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.769444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.769582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.769710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.769848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.769985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.770667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=5ca0acba1d004a8e8a1235577db30c69) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:03.770977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.772824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4d2f4-b7ab-4326-a726-85e7046e9965 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.778571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.779802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 223/442] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=6d733f44594041f5bbc6de2766346027 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.780336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f64c5-05a9-4645-8756-e4b24bd6d7aa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.790330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef3d-a37a-41d4-9844-5fa40d7c8af3 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.790622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef3d-a37a-41d4-9844-5fa40d7c8af3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.790902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41ef3d-a37a-41d4-9844-5fa40d7c8af3 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.792979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 224/443] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:03.796150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 220/444] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:03.797512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ef3d-a37a-41d4-9844-5fa40d7c8af3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.798715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.799735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.800116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.811261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41ef3d-a37a-41d4-9844-5fa40d7c8af3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.816224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.817149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.817433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.817726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] PATH_INFO: `/v3/projects/5ca0acba1d004a8e8a1235577db30c69` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.822594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:03.823813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:03.824308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] RBAC: Authorizing `identity:get_project(project_id=5ca0acba1d004a8e8a1235577db30c69)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.826465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.828298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 225/445] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/projects/5ca0acba1d004a8e8a1235577db30c69 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:03.837199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 221/446] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:03.838057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.852593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f658be2-cb45-4e81-9ba1-f076261f1eba admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.858072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.859228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.859690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.860139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] PATH_INFO: `/v3/groups/1dab1e638f3548658ba3c37c7654b38b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.863293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.864212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] RBAC: Authorizing `identity:get_group(group_id=1dab1e638f3548658ba3c37c7654b38b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.867907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.870972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 226/447] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/groups/1dab1e638f3548658ba3c37c7654b38b => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.878442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c6440-6d1d-4733-927a-1b0ddc16aca9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.878790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.883841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.884648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.884957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.885237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.889578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4c092-4f22-4525-a178-5c1c36484398 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.895682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.896373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.896657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.896963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.897864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] RBAC: Adding query filter params (group.id=1dab1e638f3548658ba3c37c7654b38b, role.id=07cb4a4189484db884216c920f46ba3d, scope.project.id=5ca0acba1d004a8e8a1235577db30c69) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:03.898347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.899319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:03.900153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.906349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:03.907790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 222/448] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:03.908723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 227/449] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/role_assignments?group.id=1dab1e638f3548658ba3c37c7654b38b&scope.project.id=5ca0acba1d004a8e8a1235577db30c69&role.id=07cb4a4189484db884216c920f46ba3d => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:03.915183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.933724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbed11-239e-4aef-9ff9-763f8f7a3bc8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.941936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.943300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.943938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.944547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:03.946217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:03.946916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:03.950307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:03.973919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 223/450] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:03.976602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:03.992868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75263a58-b296-4c19-8390-1f9425fe920d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:03.998092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:03.998760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:03.999071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:03.999439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:04.012612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:04.016176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:04.030814 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 228/451] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:04.041200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:04.054277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507a0c4-79fe-40ff-ae29-2b5b63635129 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:04.059940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:04.060879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:04.061294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:04.061647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] PATH_INFO: `/v3/projects/14db3a76771b4984aca50bf3056efc27` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:04.063639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] RBAC: Authorizing `identity:get_project(project_id=14db3a76771b4984aca50bf3056efc27)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:04.067439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:04.069418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 224/452] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:07:04 2022] GET /identity/v3/projects/14db3a76771b4984aca50bf3056efc27 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:04.075456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:04.085872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54202-ce30-40bc-a0df-139ab064a8c0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:04.090412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:04.091279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:04.091567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:04.091846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] PATH_INFO: `/v3/groups/5c27cc940fd44ca2a925075eeb1eded5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:04.093134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] RBAC: Authorizing `identity:get_group(group_id=5c27cc940fd44ca2a925075eeb1eded5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:04.095125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49a65-98e1-49d6-bedb-9996ac3d0340 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:04.097612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 229/453] 10.222.0.45 () {56 vars in 1201 bytes} [Tue Feb 15 04:07:04 2022] GET /identity/v3/groups/5c27cc940fd44ca2a925075eeb1eded5 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:04.103581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:04.114618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b1f24-7d4c-44c3-a6f0-76ed424dc421 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:04.119106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:04.119750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:04.120028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:04.120298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:04.121179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] RBAC: Adding query filter params (group.id=5c27cc940fd44ca2a925075eeb1eded5, role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=14db3a76771b4984aca50bf3056efc27) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:04.121499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:04.123317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42082523-18ef-4e41-a40c-9e17286c07ea admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:04.130752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 225/454] 10.222.0.45 () {56 vars in 1397 bytes} [Tue Feb 15 04:07:04 2022] GET /identity/v3/role_assignments?group.id=5c27cc940fd44ca2a925075eeb1eded5&scope.project.id=14db3a76771b4984aca50bf3056efc27&role.id=3e51986d5b3b4564805a85330713b776 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:07.531036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957c4f-ff2d-4e83-bafd-3174f16cdd70 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.531794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957c4f-ff2d-4e83-bafd-3174f16cdd70 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.531794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75957c4f-ff2d-4e83-bafd-3174f16cdd70 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.534182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 230/455] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:07.551390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e06c6-24f6-40ec-86c5-8a24d62ddecd None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.552048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e06c6-24f6-40ec-86c5-8a24d62ddecd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.552334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e06c6-24f6-40ec-86c5-8a24d62ddecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.597480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-911e06c6-24f6-40ec-86c5-8a24d62ddecd None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:07.599328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-911e06c6-24f6-40ec-86c5-8a24d62ddecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:07.620429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 226/456] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:07.659843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75957c4f-ff2d-4e83-bafd-3174f16cdd70 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.687332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75957c4f-ff2d-4e83-bafd-3174f16cdd70 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:07.699571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:07.700972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.701474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.701959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.708250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad38ae-bc6f-47aa-96fb-7a651dbabb1d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.708751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad38ae-bc6f-47aa-96fb-7a651dbabb1d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.709279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad38ae-bc6f-47aa-96fb-7a651dbabb1d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.713011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 227/457] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:07.718929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474358d4-587d-47bd-9626-caf967b912ce None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.719443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474358d4-587d-47bd-9626-caf967b912ce None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.719935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474358d4-587d-47bd-9626-caf967b912ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.732048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:07.733953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:07.758857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-474358d4-587d-47bd-9626-caf967b912ce None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:07.760050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-474358d4-587d-47bd-9626-caf967b912ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:07.769936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:07.773102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 231/458] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:07.782718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 228/459] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:07.790468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.809469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474358d4-587d-47bd-9626-caf967b912ce None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.818566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84d272-00fd-4b23-b80b-bfa73b0ffb81 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:07.825561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474358d4-587d-47bd-9626-caf967b912ce None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:07.827335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:07.828013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.828294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.828569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.829337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:07.829640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:07.833919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aeae6-cb10-4465-a4be-7b0fdf8a508e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:07.838084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:07.838880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.839160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.839430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.855508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:07.857740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:07.863920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 232/460] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:07.863920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069532d8-3a5c-4529-8a7f-d4f10a7f1584 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.863920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069532d8-3a5c-4529-8a7f-d4f10a7f1584 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.863920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069532d8-3a5c-4529-8a7f-d4f10a7f1584 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.863920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 233/461] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:07.868725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069532d8-3a5c-4529-8a7f-d4f10a7f1584 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.881616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069532d8-3a5c-4529-8a7f-d4f10a7f1584 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:07.883908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-84f1f132-98d2-4b5d-813a-c96dddb6395d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:07.885907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 229/462] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:07.886169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:07.886834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.887117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.887395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.888117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:07.888379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.888843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.889344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.892311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:07.919341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:07.920005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 234/463] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:07 2022] POST /identity/v3/users => generated 248 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:07.925298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.928572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:07.932470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca2c43-c94c-40b1-a5b7-a2c148b2a477 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:07.937878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:07.938574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:07.938914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:07.939191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:07.940319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:07.940575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:07.942577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:07.947540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 230/464] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:07.968301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 235/465] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:07.974753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.992960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:07.995019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb6050-3afc-437a-b6f1-e6a1fe80ff3b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.004910 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bb2c7-d849-4db4-982e-4130d89e3d24 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.007062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.007958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.008438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.008936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.009600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.010148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.010704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.010990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.011259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.013170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.023495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.025420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.047928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:08.050059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 236/466] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:08.056269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:08.063529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 231/467] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:07 2022] POST /identity/v3/users => generated 246 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:08.073589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b82c675-fbe6-4cd9-b760-b30f7e683654 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.082672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.083930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.084433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.084926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.085810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:08.086135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.094287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85b07-166d-4dfc-bf4a-796b378c1dd5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.113461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 237/468] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:08.122696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:08.142610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27044a96-1fcf-4f9f-b9f6-3cd37ba33819 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.152055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.153256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.153811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.154297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.155324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.157828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096f791-61ba-45f7-be59-a4bdcd41ae6f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.186309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 232/469] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:08 2022] POST /identity/v3/users => generated 248 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:08.567606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830e94-0177-464e-b2c7-73e49d42b978 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.568667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830e94-0177-464e-b2c7-73e49d42b978 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.569174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83830e94-0177-464e-b2c7-73e49d42b978 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.571456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 238/470] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:08.577029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.577890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.578400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.604761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:08.606000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:08.619844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 233/471] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:08.645549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83830e94-0177-464e-b2c7-73e49d42b978 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:08.677520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83830e94-0177-464e-b2c7-73e49d42b978 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.683898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.684822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.685319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.685742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.686854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.689252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.704569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.sql.core [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 15 04:07:08.704569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 15 04:07:08.704569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [parameters: {'id': 'a311dd17b97c4638aa40805c7d73bead', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 15 04:07:08.704569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79225) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 15 04:07:08.735182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 15 04:07:08.738770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 239/472] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:07:08 2022] POST /identity/v3/roles => generated 144 bytes in 94 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:08.744410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:08.762451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48b541-2372-4a7d-b9dc-293ee8f9278e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.778211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.779034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.779312 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.779584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.801912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:08.809300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-c58e094d-7af3-442e-aa93-d75c0cb6e29c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 15 04:07:08.810535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 234/473] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:08.817139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:08.849634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dedf2a-a97a-497e-909a-4e27b0f963d2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:08.868145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:08.869338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.869846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.870342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.871788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:08.872341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:08.875461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e6834-da68-4cf5-a140-185210007b13 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:08.903347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 240/474] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:08.949519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224067d0-1908-46b2-a605-90a169bbb287 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.950151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224067d0-1908-46b2-a605-90a169bbb287 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.950620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224067d0-1908-46b2-a605-90a169bbb287 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:08.952935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 235/475] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:08.963991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:08.964501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:08.965032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:09.012649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:09.014756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:09.037827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 241/476] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:09.082309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224067d0-1908-46b2-a605-90a169bbb287 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:09.103353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224067d0-1908-46b2-a605-90a169bbb287 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:09.113571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:09.114408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:09.114658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:09.114931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:09.137684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:09.139603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:09.163903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:09.169849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 236/477] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:09.171839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:09.201219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e09c5-734e-486b-92eb-278b5c56d910 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:09.215171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:09.216273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:09.216795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:09.217283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:09.218238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:09.218862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:09.221505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081b3d5-6b7c-4ce8-aa19-9ea7dab90e7c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:09.244509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 242/478] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:09.250380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:09.271225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70770a80-7388-42c1-a3a9-9496b84ef0fb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:09.281296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:09.281978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:09.282262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:09.282539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:09.283345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:09.285441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465bcdc-cf8d-4a75-b5e4-a2d6c6b92ea8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:09.313999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 237/479] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:09 2022] POST /identity/v3/users => generated 249 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:07:11.145546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307333f1-360e-402b-994d-f71cb457e2f8 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.146041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307333f1-360e-402b-994d-f71cb457e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.146041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307333f1-360e-402b-994d-f71cb457e2f8 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.148078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 243/480] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:11.153899 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.154370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.154444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.181975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:11.183188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:11.194611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 238/481] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:11.235934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307333f1-360e-402b-994d-f71cb457e2f8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.256354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307333f1-360e-402b-994d-f71cb457e2f8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.268138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.269549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.270060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.270536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.293996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:11.301640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:11.307943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 244/482] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.309597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.327627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a85c5-d33a-4ce0-b194-8a20c8a9f742 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.341719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.342411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.342695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.342972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.343756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.344064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.345774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44756d52-2dea-480c-9538-527ef0a15564 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.355363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 239/483] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.361145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.372687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684ef84-189f-465a-8ee1-a48e1dbc8c2f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.382502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.382869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7699e49-f840-4149-9b0f-c60b5cc9e03c None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.383158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7699e49-f840-4149-9b0f-c60b5cc9e03c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.383437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7699e49-f840-4149-9b0f-c60b5cc9e03c None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.384310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.384801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.385663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.387268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 240/484] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:11.391882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ddbe-a76b-4b20-aeb5-19fb27acd9c7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.392190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ddbe-a76b-4b20-aeb5-19fb27acd9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.392956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ddbe-a76b-4b20-aeb5-19fb27acd9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.403945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.408741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.415518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6442ddbe-a76b-4b20-aeb5-19fb27acd9c7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:11.416726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6442ddbe-a76b-4b20-aeb5-19fb27acd9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:11.426485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 241/485] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:11.427888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abb1a8-b73d-4d2e-8271-75d4b1154c08 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.428172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abb1a8-b73d-4d2e-8271-75d4b1154c08 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.428446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abb1a8-b73d-4d2e-8271-75d4b1154c08 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.436088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 242/486] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:11.443409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.450415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.451397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.460561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:11.468943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 245/487] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.468943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.473566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3657712-11ee-46e9-aaf3-62f3452084b6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.478528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.479033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.479327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.479651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.492678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:11.498810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:11.499930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:11.501164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:11.501549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 246/488] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.503009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.520318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 243/489] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:11.520569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3b7ab-f00b-438d-affa-456290705732 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.522429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.525307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.525992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.526330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.526584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.527285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.527590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.529307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.542413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 247/490] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.543694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7cdb-063c-41a3-aed5-346f219882de None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.552136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f1781-8317-4612-a910-83a909167419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.552881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.553354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f1781-8317-4612-a910-83a909167419 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.553879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f1781-8317-4612-a910-83a909167419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.554321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f1781-8317-4612-a910-83a909167419 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.555832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f1781-8317-4612-a910-83a909167419 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.556400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f1781-8317-4612-a910-83a909167419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.559553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f1781-8317-4612-a910-83a909167419 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.565819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66753-69d4-466a-a025-d28793eea2db admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.571265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.572604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.573158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.573506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 244/491] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.573925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.579229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f1781-8317-4612-a910-83a909167419 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.592261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f1781-8317-4612-a910-83a909167419 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.594732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.598660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.599259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.600356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.600977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.601469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.617156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:11.624742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:11.626450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 245/492] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.628296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.629357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:11.631725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 248/493] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.633615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.642094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7caed-0142-4d40-bd21-ee9dd40d8ed7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.649534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.650792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.651313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.651834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.652692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76e416-ef9c-41ea-a81e-7341a4b17892 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.660576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.661578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.662844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.663278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.665155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.665632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.667519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.668624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.669995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.687979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 249/494] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:11.690286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.692015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:11.693816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 246/495] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.694910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.706839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661302bc-d88f-49ef-891a-9af3d76eb1c4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.708883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ebd1b-aa4e-437e-bb5b-d6b4ff0b8828 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.712585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.713916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.714498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.715113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.715812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.722066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.722622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.723078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.724801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.725082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.727490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:11.727490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:11.727490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:11.729584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.738622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.741040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.770013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:11.772540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 247/496] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.774023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.792339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033ac06-da85-4080-9fcd-062d27b6472c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.797105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 250/497] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.798452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.800038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.801096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.801563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.801982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.803318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.803816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.805621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:11.805621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:11.805621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:11.807143 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.812095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d1ee8-42f5-432d-ace7-a92cfce97c7c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.817717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.818806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.819307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.819849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.820855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.821455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.823391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.838826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 251/498] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.839898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 248/499] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.840314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.848933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.852105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae633c5e-3df6-4fa0-bbaa-a2a20019d436 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.857159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.857839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.858121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.858402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.858538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9660-1469-4fb1-8c7a-04f210824985 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.864284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.865174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.865458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.865734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.869033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.871014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.875725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.879693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.882563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 252/500] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:11.883477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.894749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca438da0-c708-4aaa-b768-a71dc447b68e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.899924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.900810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 15 04:07:11.900952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.901209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.901557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.903182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 249/501] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.904679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.912510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.916625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.925155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba6075-7316-44f4-8d07-e3c23682ca36 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.931795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 15 04:07:11.933502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 253/502] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:11.940737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.945212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.946752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93890344-2603-4c6e-8513-cbc2734218f8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:11.947467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.948238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.948969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.952408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:11.953199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:11.953499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:11.953766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:11.954727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:11.956009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.958230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.979951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:11.981560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 254/503] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:11.982486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:11.984361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:11.994282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcf472-373e-445a-a0e3-71ab903086f7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.000078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.000875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.001316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.001683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.002927 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.003310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.005557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.028462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 255/504] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.035311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.036314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:12.040323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 250/505] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.042221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.042560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414f00c-e38a-410d-b3e0-5bce9d6d2c4a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.048184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.049444 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.049755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.050028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.056435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443c051-024d-429d-bac7-1cda0c58b09f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.061317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.064344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.064857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.065820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.066344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.066780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.077461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.079739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.081990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 256/506] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:12.083487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.091568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 251/507] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:12.092783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.103684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f948e-c5df-4466-a463-3e7a594ce1ba admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.105564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840860c9-3172-40fd-b4f9-49f13a1785dd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.110689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.112374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.112618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.113141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.113590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.113987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.114565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.115141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.116879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.117587 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.121148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.130673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.136399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.138173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 257/508] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.143980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.154973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41bccb-fa4d-452b-82af-826764a68369 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.166989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.168140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.168624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.169156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.170594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:12.173206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 252/509] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.175684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.184519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.186764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.198202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b9deb-2025-4ca1-8117-6664c641c62d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.206662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.207936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.208436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.208964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.209404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:12.211067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 258/510] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.212150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.224052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7073365-3652-4c7a-90e3-c8ea29432001 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.225175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.227604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.233694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.235224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.235958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.237193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.238661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.239196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.242345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9ae6d-9a17-4126-805b-a3d053817b5e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.243832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:12.245333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 253/511] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.249888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.264871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 259/512] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.269102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaaa0-4134-4799-977d-516521add3f0 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.269102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaaa0-4134-4799-977d-516521add3f0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.269274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad52c4-5acd-42ba-be13-c75a1eb16eb2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.269347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efaaa0-4134-4799-977d-516521add3f0 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.272839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 260/513] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:12.274044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efaaa0-4134-4799-977d-516521add3f0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.279715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.280414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.280687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.281000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.281751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.282056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.284338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.295169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efaaa0-4134-4799-977d-516521add3f0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.297809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 254/514] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.299476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.303161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.304271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.304742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.305250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.306752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.307306 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.309248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:12.309248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:12.309248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:12.311395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1a396-e04c-4679-907d-592ad0978b8f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.316022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4a15b-149f-4ff9-99b7-10c45f000b98 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.320643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.321486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.321767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.322040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.329642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.332186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.346537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 261/515] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.346980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:12.349203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.349838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.350640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.353291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 255/516] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.354274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.365211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16308-2a3a-4fc9-ad01-fd468926abe6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.369945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.370730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.371009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.371284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.380181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.382200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.385182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:12.387570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:12.396741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:12.404830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 256/517] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.404830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.407571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 262/518] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:12.409498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.422818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635d3fa-3148-475c-80f1-f4c3e6dc952b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.424143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3f282-51a8-4c78-ade6-74bfb66e0bbb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.430739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.431132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.431951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.432140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.432476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.432676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.433001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.433165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.434443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.434620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.434959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.435183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.436881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:12.436881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:12.436881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:12.438242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.439166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.448766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 263/519] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.450145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.471376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09b70f-cf4d-43a6-bb1c-8f434534d97e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.471644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 257/520] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.477369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.485816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.487251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.487653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.488162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.489938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.490507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.493854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.497281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7f0ce-3607-4760-b872-a15182b7a3e7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.505733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.507398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.508081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.508752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.519101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 264/521] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.520650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.529456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.534056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.537553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb47ae3-abd9-42ee-b446-5fb1ef6327b7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.544663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.545771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.546246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.546718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.548257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=920aa75581fb41b0b6b09e07399a01b6) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.549333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.552460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.569101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 265/522] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/role_assignments?user.id=920aa75581fb41b0b6b09e07399a01b6&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.570719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.571837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:12.574640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 258/523] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:12.584927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.591279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e00c1-f811-4ecc-96ea-bc0e7db35e39 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.597510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7444b9-04b8-4cc1-93b7-40a0b04e74d5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.598803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.599901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.600376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.600849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.602432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=7a77604b8ff64cf883d700d2563ab131) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.602959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.606669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.610678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.611919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.612238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.612517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.613384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:12.613743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.615491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2fce0-7242-4a67-82c2-077d0675440e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.618413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 266/524] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/role_assignments?user.id=7a77604b8ff64cf883d700d2563ab131&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.657614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 259/525] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:12.664163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:12.685498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046c50-a3b8-4d4e-89a2-d04b7eaf8563 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:12.694235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:12.695323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:12.695774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:12.696212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:12.697407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:12.700624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538e31-f955-4c3a-9fd1-d67dcda2073f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:12.739147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 267/526] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:12 2022] POST /identity/v3/users => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:13.206428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eea5f-ae6e-423f-8ed4-d969492ee129 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.207138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eea5f-ae6e-423f-8ed4-d969492ee129 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.207763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eea5f-ae6e-423f-8ed4-d969492ee129 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.211613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 260/527] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:13.220646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.221296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.221877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.252402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:13.254660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:13.268824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 268/528] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:13.309693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eea5f-ae6e-423f-8ed4-d969492ee129 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.331785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eea5f-ae6e-423f-8ed4-d969492ee129 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.339347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.340609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.341111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.341558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.361743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:13.375641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:13.378477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 261/529] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:13.387621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.404366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b2a4f-fc31-418f-a1c5-cdd039700dbf None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.412869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.414065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.414565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.415059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.416514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:13.417097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.420184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.436847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 269/530] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:13.446373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.465404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c0cf1-a5eb-4d5f-bf98-f86e5e633ee2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.473832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.475215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.475678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.476215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.497641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.501547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.528960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:13.530479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 262/531] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:13.537209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.547339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c6d50-c2f7-458a-aa02-98bdedbbb699 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.553409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.554128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.554456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.554782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.555464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:13.555767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.557488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.572008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 270/532] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:13.578095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.609009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc24b1-3682-4eb0-a3fc-2a6d0ceb5be3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.623348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.624698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.625211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.625689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.641672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.646253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.676033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 15 04:07:13.678414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 263/533] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:13.686343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.704265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3626d-a540-44dd-9732-60912cb4e8b2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.716984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.717655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.717934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.718208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.719121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:13.719427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.724571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.759364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 271/534] 10.222.0.45 () {56 vars in 1160 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:13.765820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.792732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dba473-22ed-4018-909b-91c614ba5cb1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.804910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.806016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.806497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.806959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.831579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.834896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.859864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 264/535] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:13.865708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.878579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c64b7-55ea-4759-bc3b-5ffe7c21f624 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.890380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.891242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.891520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.891789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.907225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.913811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.937332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:13.938899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 272/536] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:13.945634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.957824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d650cd-c518-493e-958b-f425c87ac401 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:13.962574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:13.963242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:13.963521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:13.963792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:13.964531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:13.964836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:13.966723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:13.981548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 265/537] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:13.988258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:13.998891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4b095-aad6-48e2-b29d-15b599f63c50 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:14.005148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:14.005991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:14.006272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:14.006621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:14.014951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:14.017116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:14.031690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:14.033920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 273/538] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:14.039560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:14.050986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589b78-1229-4b05-b633-7073d4687f02 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:14.055685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:14.056389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:14.056663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:14.057003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:14.057801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:14.058137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:14.060051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d28f8dc-bfa4-4ec1-a997-259f7b36d23c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:14.079409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 266/539] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:14.087406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:14.100024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd6f66-3530-4f58-9404-5b39aff8923e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:14.110617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:14.112882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:14.113236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:14.113518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:14.114478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f6dc0a5c1c714f0fb516cb1a6824ea83) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:14.114789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:14.116743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9e24-51d5-4eb6-9153-ee05d4cd9473 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:14.129158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 274/540] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:14 2022] GET /identity/v3/role_assignments?user.id=f6dc0a5c1c714f0fb516cb1a6824ea83&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:15.455456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890b1-d12d-4de4-8c95-766076137927 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.456425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890b1-d12d-4de4-8c95-766076137927 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.456710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74890b1-d12d-4de4-8c95-766076137927 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.458973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 267/541] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:15.465194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.465856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.465856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.487675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:15.488934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:15.497233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 275/542] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:15.534494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74890b1-d12d-4de4-8c95-766076137927 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:15.567713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74890b1-d12d-4de4-8c95-766076137927 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:15.581723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:15.583113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.583604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.584091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.614473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:15.628653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:15.635726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 268/543] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:15.642380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:15.673469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf022f-d0e9-4e90-9fa1-e8f36e30b8c1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:15.688676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:15.690290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.690785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.691280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.692269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:15.692578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:15.695704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:15.721363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 276/544] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:15.730958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:15.761408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819af5-d362-44e3-8f89-6e4b533ccb3c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:15.779675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:15.781010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.781463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.781895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.808908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:15.810808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:15.839311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:15.840885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 269/545] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:15.847772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:15.875141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc05f8-67ae-4ddf-ae9c-89ad717a8d4d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:15.883167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:15.884252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.884742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.889458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.890972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:15.891511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:15.895232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40945955-01c4-4dee-acaf-91a334802264 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:15.926536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 277/546] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:15.931650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:15.947979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f119fe-17a6-4fdb-88e3-6107e4cffabd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:15.951247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616d87-6554-4020-b7f4-81067a6be26d None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.951534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616d87-6554-4020-b7f4-81067a6be26d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.952078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9616d87-6554-4020-b7f4-81067a6be26d None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.955605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 278/547] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:15.961440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:15.962265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.962543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.962820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.963969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:15.964472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:15.965002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:15.979184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:15.981291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.014144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:16.015554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:16.018973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 15 04:07:16.021046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 270/548] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:16.027218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.040844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 279/549] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:16.054205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a44983-fce0-4baf-9b02-63d7c4afc1a9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.060707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.061858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.062621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.063246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.064758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.065452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.067073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:16.067073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:16.067073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:16.069347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812db578-2465-4a24-bb6d-45e2a7eb48ee admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.083518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.100367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817c6b8-0e02-49e1-8358-fe89633f476f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.108615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.110609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.111972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.112583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.130107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 271/550] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.132012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b4a-f4a0-4a0c-8203-8a67b45fcc21 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.132463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b4a-f4a0-4a0c-8203-8a67b45fcc21 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.133032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992b4a-f4a0-4a0c-8203-8a67b45fcc21 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.135198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:16.136603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 272/551] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:16.137644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41992b4a-f4a0-4a0c-8203-8a67b45fcc21 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.151135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d72ff546-dd0b-43a3-bfb1-e55c072b08d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:16.159967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41992b4a-f4a0-4a0c-8203-8a67b45fcc21 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.160474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 280/552] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:16.163463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.164382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.165147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.170852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.170852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.170852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.170852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.195018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.199048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.200941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:16.203525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:16.219700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 281/553] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:16.222517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.235874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:16.239129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 273/554] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.242845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af200227-e579-4f42-ba7a-1824219c2eca None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.247697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.252383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.254087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.254959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.255805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.257615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.258255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.260680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.279826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 282/555] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.279826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.280159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edec91-0181-4bcf-91b2-c70e6f31221d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.285491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.286167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.286446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.286776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.287585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.287993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.290138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.302392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9d718-678f-4f19-b697-73414db6f86a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.304967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 274/556] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.305809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.311862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.313822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.315239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.316143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.316694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65540-c831-47a0-8147-97da8c9e9e17 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.321530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.322315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.322622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.322903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.335713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.337635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.340978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:16.355486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:16.356871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:16.365279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 275/557] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.365279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.368188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 283/558] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.368786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2d91c-9d3d-405a-96dc-b987bf840079 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.375840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.381245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.382201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.382580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.382957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.391280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.393591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.400070 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da94b10-8480-409c-a96e-2f09016ae1af admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.408568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.409843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:16.410347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.411118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.411385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 276/559] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.412132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.412381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.414231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.415131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.418853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.423315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6bdc9b-2cd4-4d48-a338-d5e4cc042bde admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.428946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.429797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.430179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.430556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.431428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.431836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.433607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.442501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 277/560] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.443459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.453098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 284/561] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.455863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.458405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a81ad-4435-475e-a661-d48c07561f26 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.463215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.464007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.464360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.464705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.465623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.466002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.467969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.478835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec4e7-6a56-421c-89df-8078a16db9b9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.482587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 278/562] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.483614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.490382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.492190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.492965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.493734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.495513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d641e-f811-47dc-b26c-784443687e7f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.500311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.501059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.501411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.501814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.510168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.512709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.517136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.520828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.528875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:16.536940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 279/563] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.536940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.542963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9865f-8e0f-420e-8d9b-697babc81492 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.550287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.551268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.551655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.551997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/7a77604b8ff64cf883d700d2563ab131/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.566493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:16.569571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 285/564] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.571374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.576292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=7a77604b8ff64cf883d700d2563ab131, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.579023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.589082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258911a-a247-48f2-b9ca-c3e58d7e3cd4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.596550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 280/565] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:16 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/7a77604b8ff64cf883d700d2563ab131/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:07:16.597455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.672078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.673329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.674522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.675261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.676481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.677232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.679560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.701507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4094dc-2243-4c24-827b-f0699151f18c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.702107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 286/566] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.710409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.714806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.717346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.719307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.719938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.723832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.724369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.726652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.731808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca703ec6-d9b0-4878-a716-b1c4f4027ae6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.744113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.747036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.747713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.748212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.761025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 281/567] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.768422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.769840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.780058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.785866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61e64d-0e13-41e8-a34f-24c9c23eb824 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.797538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.800167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.801106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.801724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.822639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:16.824022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.827110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.830762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 287/568] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.838996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.846474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 15 04:07:16.848472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 282/569] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.857292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.869850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4d230-78ec-4633-9b1f-90f14973d609 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.872478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a258d7-2d32-40c0-aa25-9c6f6935af8a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.882405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.884535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.885802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.886430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.886913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.887966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.889340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.890010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.890504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.891088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.892196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:16.894007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.895304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630e94e-5c81-46c1-918f-69e1f69a0ec5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.897272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05536c-feed-43e0-af75-47214a4bba0b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.917701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 288/570] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.919437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00041-b6a9-4b6d-bc16-3e158ac38c54 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.919845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00041-b6a9-4b6d-bc16-3e158ac38c54 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.920224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be00041-b6a9-4b6d-bc16-3e158ac38c54 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.922595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 289/571] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:16.929218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00041-b6a9-4b6d-bc16-3e158ac38c54 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.930927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 283/572] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:16.933250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.933717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.934122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.956615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:16.957107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:16.957872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be00041-b6a9-4b6d-bc16-3e158ac38c54 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.964005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.965079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.965512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.965945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.967453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 284/573] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:16.968295 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:16.975091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.977447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:16.977927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca67d9c-44bb-46be-93a9-1de5db22166b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:16.982675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:16.983469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:16.983749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:16.984024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:16.997378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:16.997774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:16.999027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 290/574] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:16.999668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.000185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.011675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e992eee-ac44-4f21-a8b0-e81772eb2487 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.016422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.018678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.018968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.019244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.031523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:17.040044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:17.041739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 291/575] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.042630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.044983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:17.046327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 285/576] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.054890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.059251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56c870-e10c-42e1-9015-b6255582bd72 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.064532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.065714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.066107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.066515 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.067442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.067880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.069961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.076072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac9d64-0afb-4652-b7ca-3beaeada1110 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.085683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 292/577] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.086463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.086843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.087731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.088469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.088987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.090352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.090829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.095175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.099517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c8ca6-8de6-48d9-84b9-17a569b85171 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.109596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.110448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.110863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.111253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.112610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.113162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.115000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.120253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 286/578] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.122277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.125014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 293/579] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.126000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.143747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ace466-ec8e-406d-9a92-373f839e6ab7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.144052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1860b-4a61-4f27-af4a-7cba9b14e508 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.149118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.149392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.150022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.150288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.150443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.150587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.150956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.151365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.160578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.162967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.169141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=f839e77bd3ad430d96b6957d398ec04a, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.172330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.179455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:17.181512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 294/580] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.182430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.197349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d79ee-463f-4a7d-bd53-343b428d48fc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.197742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 287/581] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:17 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:07:17.198609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.285304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.287248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.288664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.289009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.300807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a93ce-2108-4555-b1fc-c7399d4f58a3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.310486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.312137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.312515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.312750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.315701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.316693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.318904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.319832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.321985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.355200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 288/582] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.357349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:17.358691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 295/583] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.366509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.366960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.380860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712b924-be7c-40ba-bb9f-a9e81229599d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.386278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e949b8-a568-4b85-a1b3-17987ce1fc3b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.393721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.394404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.394683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.394960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.395717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.396022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.397786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.402486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.402486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.402486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.402486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/920aa75581fb41b0b6b09e07399a01b6/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.431472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 289/584] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.437729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.456175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358895c-02de-4dd3-9b09-17aece849a90 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.459417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=920aa75581fb41b0b6b09e07399a01b6, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.464474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.478671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.480105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.480621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.481105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.498979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.501067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.502234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 296/585] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:17 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/920aa75581fb41b0b6b09e07399a01b6/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:07:17.519776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:17.522301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 290/586] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:17.528781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.615576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c9ddf-eb90-4699-8ec8-75d22ce877f4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.627674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.628474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.628762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.629065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.629964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.630273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.632234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.655270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 297/587] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.661221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.671892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7423f52-4f1b-4138-b552-28b915251864 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.685898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.686658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.686986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.687304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.703868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.706809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.725637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 291/588] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:17.732400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.743441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0953288-b0d6-4ad3-ae04-c4afb6f7089c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.755938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.756755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.757073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.757348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.773457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.775497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.796571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c5517d2a-9925-45c0-a9b7-8dd2d818ec96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:17.798289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 298/589] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.804474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.816112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464038f-97d4-48f9-b4c0-082a33ec65c6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.816634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464038f-97d4-48f9-b4c0-082a33ec65c6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.817115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464038f-97d4-48f9-b4c0-082a33ec65c6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.819045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8800f8-72aa-4a61-827c-2b10cc0825dd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.819764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 299/590] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:17.825746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.826262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.826671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.829475 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.831969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.832288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.832600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.833515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.833844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.835767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.851946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 292/591] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:17.858139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:17.858411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.859880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:17.871998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 300/592] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:17.872334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8569d1-3520-4039-b8cd-f21231a9f8c8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.885419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.886388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.886743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.887090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.900823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.902918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.924067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:17.931851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 293/593] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:17.932413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.937924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:17.950932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b640b61-8ef4-48cd-ac7a-a3ad7511c343 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.958064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9c7e5-20d3-415c-9050-655b58115ad1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:17.962679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.964196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.965048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.965981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.971214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:17.973187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:17.975919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:17.976420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:17.977464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:17.977954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:17.979997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:17.997866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:18.006764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:18.007021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 294/594] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:18.013461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 301/595] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:18.020590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.020795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.032058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de85037-3af9-4745-8ea4-677141cfbcf3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.037793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.038818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.039405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.039546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77ed37-7d28-4b87-b505-18733a4d64d2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.040025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.041294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.041914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.043830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.056750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 302/596] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:18.063020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.065730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.066432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.066715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.066987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.067852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=d4d68bfed8d44a77a98bb887be0efd05) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.068161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.070118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.078955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 295/597] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/role_assignments?user.id=d4d68bfed8d44a77a98bb887be0efd05&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:18.087021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51947651-83c6-422b-a11d-60c85eed34a5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.098064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.099200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.099735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.100181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.116465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.118707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.140548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:18.142616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 303/598] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:18.149131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.161264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6f84-2352-4702-b0eb-f1b8cc5ea5d3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.166628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.167673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.168274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.168745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.169736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.170278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.172167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.188276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 296/599] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:18.195301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.208069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f395332-bf1b-4984-be49-ede34edf3ca1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.217757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.219012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.219589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.220058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.235592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.238694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.260432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 15 04:07:18.262466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 304/600] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:18.269230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.280119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91359d-761d-4fae-9b56-47bbe1f73db3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.286064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.287161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.287671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.288142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.289263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.289778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.291921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.314770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 297/601] 10.222.0.45 () {56 vars in 1160 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:18.320680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.331690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123c5c6-3889-4134-ae5f-bdefb9490534 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.336701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.337776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.338290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.338759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.351898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.354240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.374406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:18.376354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 305/602] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:18.382762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.393894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee042-4674-415e-a986-6d998d804cd1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.398743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.399705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.400207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.400685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.401746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.402243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.404115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.417639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 298/603] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:18.424008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.434637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2caaa-17a0-4a2d-a122-9b01ee2164f5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.440601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.441705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.442249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.442730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.450545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.452773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.466760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:18.468563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 306/604] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:18.474963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.485602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06945a66-b645-4350-a5e1-e600f3012b7f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.491869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.492779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.493286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.493825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.494806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:18.495303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.497375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e2e39-5d1c-4209-a7cd-59465413ea18 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.511950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 299/605] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:18.518844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:18.530237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df61ff-7421-41f5-8d75-a16fe554a9fa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:18.536061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:18.537275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:18.537757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:18.538248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f6dc0a5c1c714f0fb516cb1a6824ea83/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:18.554738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=f6dc0a5c1c714f0fb516cb1a6824ea83, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:18.557881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3b8af-c18e-4cd9-b460-36ef00b660a8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:18.587086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 307/606] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:18 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f6dc0a5c1c714f0fb516cb1a6824ea83/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:19.677023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5ad4-6664-440a-b1ec-a94599d9beb1 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:19.678053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5ad4-6664-440a-b1ec-a94599d9beb1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:19.678533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5ad4-6664-440a-b1ec-a94599d9beb1 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:19.680995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 300/607] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:19.686995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:19.687947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:19.688419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:19.707840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:19.709486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:19.790560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 308/608] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:19.816456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5ad4-6664-440a-b1ec-a94599d9beb1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:19.830090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5ad4-6664-440a-b1ec-a94599d9beb1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:19.835309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:19.836389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:19.836886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:19.837375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:19.850701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:19.858288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:19.860246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 301/609] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:19.866385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:19.876145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3582e-02b5-48b4-b73e-e3d618735dba None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:19.886816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:19.887863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:19.888341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:19.888830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:19.889834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:19.890336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:19.892181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:19.906248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 309/610] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:19.911907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:19.922379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584111-78da-4702-b1cc-6a07e001c92c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:19.932975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:19.934102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:19.934600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:19.935075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:19.948795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:19.951014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:19.971326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:19.973275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 302/611] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:19.982063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:19.994000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659a425-099b-46b0-8814-67d94949a862 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.003452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.004457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.004964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.005459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.006420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:20.006928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.008826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.027376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 310/612] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:20.033096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.044022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06d17f-8479-49c3-a689-6134d781fffd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.053067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.054255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.054742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.055254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.066000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.068421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.092480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 15 04:07:20.094046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 303/613] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:20.100580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.112464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023d5582-81a2-40bc-a2d8-ff85b4c3e689 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.130677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.131895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.132374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.132873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.134779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:20.135651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.145625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.197212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 311/614] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:20.202199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.223596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd7e74-d3c3-4eab-b4b2-a6b59c74b190 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.233441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.234096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.234376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.234648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.249236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.250988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.265235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 304/615] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:20.271987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.295340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debf5fc-afc6-4728-b8bb-ae9b4ab78939 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.305961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.307430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.307949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.308465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.340503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.344176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.394511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:20.397337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 312/616] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:20.402376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.424190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b30d7-40ba-4abb-a428-67f65aec4fae admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.445650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.446335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.446612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.446879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.447673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:20.447920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.449600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.474831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 305/617] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:20.480538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.511812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ab20b-556a-481c-9eb6-8be036dff6db admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.528624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.530224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.530735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.531219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.553284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.557356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.596552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:20.607574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 313/618] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:20.613350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.631433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4329-dde2-4ae9-9bac-5f4e648a62a9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.650428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.651112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.651389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.651657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.652462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:20.652763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.654646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf279d8-5435-4458-81c9-0109f63f3450 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.675433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 306/619] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:20.682011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:20.706473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c22bce-9111-4f67-95b6-e02d9e3ef95a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:20.730439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:20.731670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:20.732201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:20.732709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:20.734440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=7a77604b8ff64cf883d700d2563ab131) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:20.734976 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:20.739558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0521c-5de2-45b8-9f1a-ed900fce9480 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:20.758246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 314/620] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:20 2022] GET /identity/v3/role_assignments?user.id=7a77604b8ff64cf883d700d2563ab131&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.053329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43387-c373-48c2-81e1-4c7ff1d5a3c4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.053852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43387-c373-48c2-81e1-4c7ff1d5a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.053852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a43387-c373-48c2-81e1-4c7ff1d5a3c4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.056017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 307/621] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:21.065648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.066080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.066506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.109626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:21.112356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:21.130369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 315/622] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:21.176067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43387-c373-48c2-81e1-4c7ff1d5a3c4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.196634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a43387-c373-48c2-81e1-4c7ff1d5a3c4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.203064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.203871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.204150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.204424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.223818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:21.238380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-2f1b558c-4de9-402f-990a-d5bb6fb0c19b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:21.241147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 308/623] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:21.249739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.269005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec7c4b-1a76-48b5-918e-6fbcaa9d58fc None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.274668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.275361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.275638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.275902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.276674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.277011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.278618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca2317-e313-4ae6-ad99-13c841709dd7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.295073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc4df-b3ae-4a20-836c-b540d860e889 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.295505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 316/624] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.295681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc4df-b3ae-4a20-836c-b540d860e889 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.301010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc4df-b3ae-4a20-836c-b540d860e889 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.301010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 309/625] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:21.306904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.307774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.308608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.308773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc4df-b3ae-4a20-836c-b540d860e889 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.332733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc4df-b3ae-4a20-836c-b540d860e889 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.344952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:21.347588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.348382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.348684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.348968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.349305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:21.365841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 317/626] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:21.370112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.374770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.391235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.402348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1baace-8bb4-4457-932e-2f350c2636ff None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.409043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.409860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.410196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.410470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.418968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:21.419235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 310/627] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.426113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.432443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:21.442295 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a5aea-d302-46de-9e44-a2b7fffa7396 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.448020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:21.449657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.450479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.450818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.451096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.451856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.452351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.452633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 318/628] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.457287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.463358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.477864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 311/629] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.479513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.493019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31ad26-fdc0-433f-907e-ecc2790d31e9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.495358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf957e-35fc-4ff2-9354-acc78a82798f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.497452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.498326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.498732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.499010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.512221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.513097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.513381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.513657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.516873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.517776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.519874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.521649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.523878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.543004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 319/630] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:21.549885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:21.551585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 312/631] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.557408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.557768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.568796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06738d3b-5f67-4589-86e6-088bb30427ff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.582594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.583393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.585005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.585291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.585966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352c88-bd37-4ab4-bb98-7bd15fc90b0c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.597103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.597798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.598079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.599322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.602076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.602391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.605534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.612927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.618111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.637992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:21.643109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 313/632] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.645816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.646118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 320/633] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.659830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.662741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817652a0-c1cb-4bf0-924b-3b7263591ecc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.667915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.668561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.668848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.669188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.669940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.676927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.676927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2b6ae-b1a2-450c-8342-8fa1d5452398 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.681117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52d5ad-0acc-4c00-8ecc-d3f9bdc7d4e7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.686150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.686496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 314/634] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.687356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.687835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.688297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.693071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045a82-c07e-42fa-b457-823ed811bc19 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.697402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045a82-c07e-42fa-b457-823ed811bc19 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.697691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a045a82-c07e-42fa-b457-823ed811bc19 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.700010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 315/635] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:21.705206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a045a82-c07e-42fa-b457-823ed811bc19 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.708566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.712377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb7a8f-05bc-4136-99d5-c499761af624 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.725094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a045a82-c07e-42fa-b457-823ed811bc19 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.729814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.730818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.731259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.731443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 321/636] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:21.736075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.736312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.736312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.736312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.745928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.754603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.764707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:21.766240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:21.776053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 322/637] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:21.777243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.792937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:21.792937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 316/638] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.797346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9502d-e133-4b15-b616-47701b2dbcba None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.804920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.816273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.817767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.818289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.819395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.825593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d4975-819e-41da-a7ef-dc203b9aa6c2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.833888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.835004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.835292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.835482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.835960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.837530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.838031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.838291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.841448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.860682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:21.867502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 323/639] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.868690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.876205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 317/640] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.881374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89f0df-213d-4dad-87ba-b64d67debbc0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.884460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.887235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.888317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.888938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.889406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.904215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:21.904440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e007bf0-5fdf-408e-bcbd-807f1c77855c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.911930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.913100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.913595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.914088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.914593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:21.915507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.916073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.916598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 324/641] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.920965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.922404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.934646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9e767-a979-44c9-a2b8-21e3b0b81d24 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.941382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.942326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.942710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.943091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.943283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 318/642] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:21.945255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:21.964005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.965556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6873d-3ef3-48f0-8452-649ae0a8d3ab admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:21.966190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.973824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:21.975070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:21.975672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:21.976153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:21.977440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:21.978005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:21.981154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:21.989726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:21.992034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 325/643] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:21.993124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.004279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811ddfd-fe38-4114-99d4-6269c7cd26db admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.009526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 319/644] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.009526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.016936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.019478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.020066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.020596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.028986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d69fb3-1fa6-4b48-960f-a1df86e3b015 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.030270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.033831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.037913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.039118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.039630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.040145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.041689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.042256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.045609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.054805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:22.056489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 326/645] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.062880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.072764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 320/646] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:22.076097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299281e-9e6f-4d21-be86-ef6461593192 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.082205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.082495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.083751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.084324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.084793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.102753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.104625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd61725-4c81-4fd5-86c5-a38da6e777aa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.105399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.112826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.114032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.114537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.115026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.116674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.117077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.120674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.129827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:22.131428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 327/647] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.136835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.151508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 321/648] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.151508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.152862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836c20d-7e96-4f67-b555-8eb2a42132fc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.157718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.159069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.159520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.159933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.167643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.169615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90bd9-c60c-4be2-b88a-8bc4dbccd3f3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.170205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.178626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.179871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.180483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.181146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.182881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.183571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.187049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.187915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:22.191518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 328/649] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.193148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.204135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74e774-2a6b-496a-a9d4-04b586125a31 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.210276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.211160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.211586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.211998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.213038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.213490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.215498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.221056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 322/650] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.232930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.233174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 329/651] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.238192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.267842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06607917-0918-4dac-84a5-2ec0de0f1339 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.274309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6fe0a-19b1-4938-b2ef-b624ca32d7bd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.284523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.286442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.286905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.287343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.290454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.291858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.293373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.294336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.295543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.296186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.302138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabe331-b7ff-4a72-80b8-962fb1090621 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.322093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.326272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.328486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 323/652] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.331865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049f7-80ea-4fb6-bd20-087bf2016acb None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.332152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049f7-80ea-4fb6-bd20-087bf2016acb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.332548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36049f7-80ea-4fb6-bd20-087bf2016acb None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.336932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 324/653] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:22.338498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36049f7-80ea-4fb6-bd20-087bf2016acb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.356460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-a818eb27-68df-4b75-ac47-0eab3138c887 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 15 04:07:22.358926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 330/654] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.361785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36049f7-80ea-4fb6-bd20-087bf2016acb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.362544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.363060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.363550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.369302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.370865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.371360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.371852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/d4d68bfed8d44a77a98bb887be0efd05/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.397377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:22.399905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:22.404277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=d4d68bfed8d44a77a98bb887be0efd05, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.410493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.415497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 331/655] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:22.417208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.433177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a982b80-af34-4a8d-a933-11f065418ec8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.445033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 325/656] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:22 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/d4d68bfed8d44a77a98bb887be0efd05/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:07:22.446173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.537784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.538943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.539424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.539900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.541709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.542259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.546056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.570331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa454879-8b58-424a-9733-f6008b1061dd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.578345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.579736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.580238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.580686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.582623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 332/657] 10.222.0.45 () {56 vars in 1158 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.588636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.602274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:22.608561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf27cfc-e063-4a68-920d-417a364a93c5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.616759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.617046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:22.618181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.618762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.619360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.619534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 326/658] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.625921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.635512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.639088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.648279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef354-575b-455b-8e40-09ea4a37b635 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.656761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 333/659] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:22.657027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.658847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.659544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.659892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.660875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.661285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.663665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.664327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.681027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3180cba-6fe2-413f-9caa-65d20f22f491 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.682456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 327/660] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.688271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.688675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.690391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.691066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.691681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.707783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c22e70-9d09-43ca-a070-930fcf045cdd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.709253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.713607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.717338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.719227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.719398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.719995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.746611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.750545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.751731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:22.754450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 334/661] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.761548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.783353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39aa739-2357-4893-9347-b919dd4ecc48 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.788386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:22.791355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 328/662] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:22.797353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.802726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.804021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.804591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.805253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.806874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.807534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.810959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.818357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227df8e0-3530-41f7-97da-4a2cf0d4686d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.827106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.828881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.829816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.830655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.832485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.833412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.836074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 335/663] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.837444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.843151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.863710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb389d4-bc3e-4988-b56e-9ea6d5636f83 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.865380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 329/664] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:22.871473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.878844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.880457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.881091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.881680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.894998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8c13-3be9-43dd-8281-86a7b8806886 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.895659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.900393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.904513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.906496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.907247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.908047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.925920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:22.930682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:22.930952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:22.933559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 336/665] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:22.942602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.961751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 15 04:07:22.964784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 330/666] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:22.971437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:22.976029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44186f-58f0-4101-8a4f-ec76e428f890 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.991317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:22.991882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422378-df3f-4ac1-bfa9-1b8cf0c3694f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:22.992798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:22.993622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:22.994267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:22.996169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:22.996963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.003228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.010550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.011954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.012679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.015799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.017725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:23.018524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.026471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.061975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 337/667] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:23.069480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.101777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d4543-0b08-445d-8d11-441c04e6af0d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.107747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 331/668] 10.222.0.45 () {56 vars in 1160 bytes} [Tue Feb 15 04:07:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:23.112121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.113838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.114139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.114842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.115536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.117567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=920aa75581fb41b0b6b09e07399a01b6) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:23.118400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.122002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.135461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24023786-36fb-4718-be16-9304373f12bf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.136578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 338/669] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/role_assignments?user.id=920aa75581fb41b0b6b09e07399a01b6&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:23.158269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.159286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.159630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.159916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.176661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.178482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.192680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 332/670] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:07:23.198963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.227085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f51c2-dc44-44e9-bf84-ae18f3bcc3e8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.236581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.238397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.239186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.239906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.263869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.267884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.301304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:23.303497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 339/671] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:23.308737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.323833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c6dad-bad8-411a-a44a-61d7f1e11615 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.338500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.339178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.339455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.339729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.340469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:23.340772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.342598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.363095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 333/672] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:23.367300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.378829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c868993-b619-4c30-9c56-424e7d8bda24 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.383948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.384791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.385389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.385717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.395377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.397490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.413672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:23.415226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 340/673] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:23.421058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.432502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90f02c-2be7-46f7-b100-1bc0a2cfce4f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.437431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.438166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.438442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.438712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.440663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:23.441018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.443081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdc85-bb7d-4b38-83c8-b56fca3d837b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.465071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 334/674] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:23.472574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:23.495528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec30d7-54e8-4cc4-9e9f-24ab1d64a69e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:23.507103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:23.508574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:23.509320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:23.510010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:23.512144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f6dc0a5c1c714f0fb516cb1a6824ea83) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:23.512967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:23.517510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87ac1e-788d-4a8a-a5d5-4b1adebfc93e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:23.530699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 341/675] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:23 2022] GET /identity/v3/role_assignments?user.id=f6dc0a5c1c714f0fb516cb1a6824ea83&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:24.359388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924348-deac-445f-8e16-f786f208705d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:24.360173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924348-deac-445f-8e16-f786f208705d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:24.360173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40924348-deac-445f-8e16-f786f208705d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:24.362969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 335/676] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:24.368792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:24.369557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:24.369557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:24.394926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:24.396116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:24.408672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 342/677] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:24.447889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924348-deac-445f-8e16-f786f208705d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:24.463193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40924348-deac-445f-8e16-f786f208705d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:24.474100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:24.474896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:24.475173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:24.475444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:24.490721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:24.492569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:24.514016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:24.515532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 336/678] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:24.522199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:24.531823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb8a51-be2e-465a-b6dd-a91e9f63418d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:24.537321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:24.537999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:24.538274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:24.538549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:24.539297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:24.539601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:24.541226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260f0bae-eb61-493b-89c4-b5a45532b1de admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:24.555260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 343/679] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:24.560672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:24.572046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a79c8-75c9-483a-ad4b-ebc9f58d3af6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:24.576693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:24.577442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:24.577765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:24.578039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:24.578757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:24.581788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5793aa9-4565-4ad3-963e-f7b142d8a2b0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:24.610423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 337/680] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:07:24 2022] POST /identity/v3/users => generated 254 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:25.390559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cb09-008f-4a18-9e94-e2524e007a03 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.391595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cb09-008f-4a18-9e94-e2524e007a03 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.391595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50cb09-008f-4a18-9e94-e2524e007a03 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.393862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 344/681] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:25.401093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.401966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.401966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.421225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:25.422422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:25.431713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 338/682] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:25.519694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50cb09-008f-4a18-9e94-e2524e007a03 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.536319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50cb09-008f-4a18-9e94-e2524e007a03 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.543399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.544215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.544619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.544963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.558520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:25.566111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:25.567686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 345/683] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:25.577035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.605212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7a8ec-8dfe-43ed-9c34-4c908fd9ea27 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.619477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.620605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.621217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.621648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.623148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:25.623703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:25.626966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:25.658155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 339/684] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:25.666272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.682772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11694b-e7c5-43fe-a46b-5b6aee7c2ccf admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.693217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.694142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.694432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.694681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.711248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:25.713212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:25.744373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:25.746171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 346/685] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:25.756080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.789445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72874db-c4b4-45c6-b8b1-98d325a7f5cd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.807696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.808823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.809334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.809813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.811183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:25.811691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:25.815144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:25.852287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 340/686] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:25.861574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.877956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f0d1f-2f00-43b0-a545-c02902d6e60d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.889197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.890411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.890971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.891460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.904728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:25.907290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:25.930596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:25.932588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 347/687] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:25.942213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:25.974244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36a93-e476-4181-9680-a5919e5430f3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:25.989345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:25.990506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:25.991003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:25.991488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:25.993346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:25.993925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:25.997774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.047744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 341/688] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:26.056355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.071030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7d573-7b48-4b1f-bbf1-34a9ff730d0a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.081594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.082665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.083211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.083731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.098041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.100216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.116243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 348/689] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:26.125924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.153355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc4b94-5ed4-431c-b536-f5b0bbf37e04 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.168502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.169884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.170362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.170854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.197009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.200647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.239882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:26.249066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 342/690] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:26.252858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.293106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580b6d2-438b-4cd1-8e63-bd7900fba94c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.310046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.311187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.311647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.312094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.313700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:26.314812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.317862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.351176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 349/691] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:26.359934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.387462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480b4c-8731-481e-9d9a-b7365d6468fa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.405261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.406593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.407103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.408141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.425645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.437699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.467875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:26.477473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 343/692] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:26.480713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.511641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824820d9-7d3e-4b8a-b02b-19b02027c102 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.526213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.527388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.527886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.528388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.529981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:26.530526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.534920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eceb5d-f05e-40e5-9c70-ba72d7151e59 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.566552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 350/693] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:26.576311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:26.598776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5c055-b8d6-4f1e-81ff-3ddeb55373ff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:26.611884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:26.613075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:26.613596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:26.614070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:26.615894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=d4d68bfed8d44a77a98bb887be0efd05) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:26.616392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:26.619989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b55d7-ca21-4f4a-a472-fdda45ff6705 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:26.638259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 344/694] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:26 2022] GET /identity/v3/role_assignments?user.id=d4d68bfed8d44a77a98bb887be0efd05&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:27.113122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e9cc-c6b2-45d6-a2fa-535e1a9a364e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.113522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e9cc-c6b2-45d6-a2fa-535e1a9a364e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.114020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969e9cc-c6b2-45d6-a2fa-535e1a9a364e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.117854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 351/695] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:27.125315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf879-7ae8-4403-860c-07f63e555b78 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.125807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf879-7ae8-4403-860c-07f63e555b78 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.126833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf879-7ae8-4403-860c-07f63e555b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.164212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-eb3cf879-7ae8-4403-860c-07f63e555b78 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:27.166266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eb3cf879-7ae8-4403-860c-07f63e555b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:27.186127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 345/696] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:27.209407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969e9cc-c6b2-45d6-a2fa-535e1a9a364e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.234726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969e9cc-c6b2-45d6-a2fa-535e1a9a364e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.247196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.248682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.249229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.249728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.252161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.252631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4cca-4712-4480-b6fb-7795774d4180 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.252955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4cca-4712-4480-b6fb-7795774d4180 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.253238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c4cca-4712-4480-b6fb-7795774d4180 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.254089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:27.254089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:27.254089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:27.255361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 346/697] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:27.255888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.261944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.262279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.262492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.285511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:27.286796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:27.291455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 15 04:07:27.294390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 352/698] 10.222.0.45 () {56 vars in 1150 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:27.299123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 347/699] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:27.304630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.324405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.326875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f17a9-34db-46a8-b315-3da23ac60c65 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.336221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4c73b-bc89-434f-8137-5c374aab66df None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.337743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.338886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.339395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.339986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.341068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.341521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.341871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.342071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.342185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.342404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.345489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:27.345489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:27.345489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:27.347401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.356299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 353/700] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:27.356501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:27.363023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.364121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:27.366445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 348/701] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:27.372353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.382930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810d30c-9089-4f1a-a224-028ba50570c3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.383876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f4451-47c3-483d-9418-b04bc0c11c0d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.389830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.390518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.390796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.391067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.392448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.392765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.395323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.396087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.397581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.398253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.398953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.400484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.401292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.404626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.405297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 349/702] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:27.412028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.418281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 354/703] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:27.424734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91746e1-ef1e-464f-b14f-17b9d004d1cc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.430779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.431476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.431754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.432024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.449249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.451135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.472050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:27.473738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 350/704] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:27.479469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.491610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24ea49-9e42-4861-bded-4b8b7759b657 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.496710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.497438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.497720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.497991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.498916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.499227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.500872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.516072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 355/705] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:27.522264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.532775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508732bb-1fce-4bb4-ac98-a33179960298 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.541850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.542681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.542963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.543236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.552736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.554809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.575479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:27.581037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 351/706] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:27.583407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.594000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e017a2-9e9b-488d-b923-c0c361917076 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.599460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.600283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.600566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.600842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.601787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.602096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.604104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.625972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 356/707] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:27.632927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.663330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98a0c8-e902-4656-b493-96e056530651 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.675875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.676877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.677328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.677726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.698459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.701844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7d27f-3584-4064-8a4a-5fb865516f31 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.724674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 352/708] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:27.729397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.743794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61dbda6-cfc5-42a6-b726-0f698ddf1fb1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.750961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd131d9-513d-4546-a88c-a08897352846 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.751139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.751332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd131d9-513d-4546-a88c-a08897352846 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.751332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd131d9-513d-4546-a88c-a08897352846 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.751586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.751586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.751586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.754531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 353/709] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:27.762166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.762676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.763184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.766330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.768453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.789159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:27.790740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 357/710] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:27.796547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.800600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:27.802596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:27.809292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488418-3e9c-4c90-8600-799b9bfc57fb admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.815174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.816097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.816520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.816939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.817935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:27.818371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.820226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.824271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 354/711] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:27.846007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 358/712] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:27.854718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.876111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.882240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb713-242f-43f0-bef3-19b5db1d04ff None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.890057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.891363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8564884-c0cc-45c5-bc5d-bb13d793c30e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:27.891478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.893058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.893563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.912180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.916116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.918804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:27.920197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:27.920775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:27.921313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:27.922594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:27.925815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:27.970682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 15 04:07:27.972926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 359/713] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/services/network => generated 88 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:27.979728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:27.982325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 355/714] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:27.988789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:27.991008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:28.011459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62442646-55e7-4c81-83de-e359b6554c92 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:28.015521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a8fd9-ba0a-4774-bf95-99669993c06e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:28.020124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:28.021328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.021837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.022328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.023840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:28.024406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:28.025723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:28.026571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.026990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.027400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.028260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:28.028716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:28.029886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:28.029886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:28.029886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:28.031024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:28.036629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:28.044200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 356/715] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:28.062951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:28.078798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 360/716] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:28.086418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:28.097795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9de75a-a43b-47d4-a3da-9fcc6e01e608 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:28.110295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad2469-a1e5-438d-91b7-b9b04118d8d0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:28.117952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:28.119020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.119494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.119952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.121255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:28.121789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:28.124764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e8bfeb-2164-43fd-b8ca-4b078b7149d9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:28.134641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:28.135804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.136242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.136655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.137680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:28.138133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:28.140375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c0392-1722-4a40-8ef3-41ff29d58673 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:28.141074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 357/717] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:28.155965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 361/718] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:28 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:28.909529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb85f5-aa8b-42a3-a84f-b99f2d70d743 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.910212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb85f5-aa8b-42a3-a84f-b99f2d70d743 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.910834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb85f5-aa8b-42a3-a84f-b99f2d70d743 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.914625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 358/719] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:28.923492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700d86-c69d-490a-bde2-41782079b962 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:28.924253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700d86-c69d-490a-bde2-41782079b962 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:28.924456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700d86-c69d-490a-bde2-41782079b962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:28.971471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-18700d86-c69d-490a-bde2-41782079b962 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:28.973554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-18700d86-c69d-490a-bde2-41782079b962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:28.996838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 362/720] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:29.076868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb85f5-aa8b-42a3-a84f-b99f2d70d743 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.114171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb85f5-aa8b-42a3-a84f-b99f2d70d743 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.122297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.123854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.124453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.125118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.154439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:29.169731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:29.172486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 359/721] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:29.181546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18700d86-c69d-490a-bde2-41782079b962 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.200918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18700d86-c69d-490a-bde2-41782079b962 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.213781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.214782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.215211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.215625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.216562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:29.217054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.218901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.236393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 363/722] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:29.245566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.275153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f1160-99c3-4c35-a2a6-813f6254451a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.284157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.285755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.286381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.286997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.306791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.310304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.343883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:29.347649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 360/723] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:29.355705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.371786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d853f-0fdd-43c8-be1f-1e7630eacb87 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.379432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.380391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.380824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.381267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.382150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:29.382616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.384410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.409633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 364/724] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:29.417122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.434923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578f38b-3760-4818-a7d5-4ab85af75d71 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.443654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.445252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.445748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.446332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.461772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.465854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.504135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:29.509852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 361/725] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:29.518956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.535130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6daae26-22e8-49c6-9103-61b76eb43c13 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.545580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.546638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.547138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.547635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.549742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:29.550283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.552382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.574418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 365/726] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:29.583875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.608279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918568e-b508-4e9a-b194-d03ab7402c3a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.618521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.619596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.620056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.620511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.643812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.647140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.671630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 362/727] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:29.679366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.695529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a2450-3906-4e5a-8843-c509eb139435 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.703616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.705929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.706560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.707043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.733618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.736530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.769316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:29.771243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 366/728] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:29.779251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.805155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67717-656a-455a-a53b-3fec7a505b60 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.812543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.813897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.814365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.814855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.816213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:29.816726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.819699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.841370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 363/729] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:29.849280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.864091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3a386-81f3-4f77-bfaf-0960e84a745c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.873253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.874433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.874919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.875408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.888478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.890922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:29.912219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:29.914201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 367/730] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:29.923801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:29.950657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a10ab-836e-4bc3-96b3-71ee08af4627 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:29.963624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:29.964927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:29.965563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:29.966085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:29.967830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:29.968450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:29.972968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476738e-007b-4ad6-b350-362a678b3212 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:30.008499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 364/731] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:30.016642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:30.038322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a7b82-3266-43a1-9dba-8883de2c236e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:30.047041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:30.048270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:30.049052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:30.049625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:30.050703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=72749c07825e430e9ca092a0bead2bda) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:30.051281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:30.053441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73675d2-17a7-4245-b23e-cc8553d425ad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:30.065715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 368/732] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:30 2022] GET /identity/v3/role_assignments?user.id=72749c07825e430e9ca092a0bead2bda&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:31.216222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821d6d-9898-41a9-a923-d6cd237eecde None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.216766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821d6d-9898-41a9-a923-d6cd237eecde None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.217203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6821d6d-9898-41a9-a923-d6cd237eecde None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.222078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 365/733] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:31.237118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.237663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.238010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.270080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:31.271544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:31.281133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 369/734] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:31.381077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6821d6d-9898-41a9-a923-d6cd237eecde None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.398773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6821d6d-9898-41a9-a923-d6cd237eecde None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.404619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.405443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.405732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.405982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.430372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:31.448747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:31.450966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 366/735] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:31.461911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.472773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a76eb9-3039-44bd-9b37-816a14d3b729 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.480261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.481493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.481994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.482471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.484111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:31.484675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:31.488468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:31.516917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 370/736] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:31.527679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.550891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54985eca-0273-4eed-a1e8-a6b9a0ae03d6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.564473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.565945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.566413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.566882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.599465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:31.603114 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:31.659014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:31.670638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 367/737] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:31.680403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.709240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368337b8-6589-4c09-9d03-b3fdeb4f6aca admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.728997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.728997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.728997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.728997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.729376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:31.729446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:31.732458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac14fc9-adcf-4b9d-9a83-935a942d0f97 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:31.771503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 371/738] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:31.785787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.815212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436495-c199-4cd8-8ca5-5d540b0bcf44 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.819643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82f15-b166-48a6-8db1-a04e93424d60 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.820103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82f15-b166-48a6-8db1-a04e93424d60 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.820251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b82f15-b166-48a6-8db1-a04e93424d60 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.822059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 372/739] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:31.827893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.828763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.829061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.829548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.835984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d050681-f0fc-4745-924f-bec9e7ef9961 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.837030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d050681-f0fc-4745-924f-bec9e7ef9961 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.837872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d050681-f0fc-4745-924f-bec9e7ef9961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.841885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:31.843926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:31.867401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:31.870039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 368/740] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:31.897494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:31.901962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1d050681-f0fc-4745-924f-bec9e7ef9961 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:31.903958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1d050681-f0fc-4745-924f-bec9e7ef9961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:31.919496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc66282-572c-4078-96cd-b5b44de65a11 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:31.927053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 373/741] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 15 04:07:31.928777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86a08-7de5-4938-a89f-914c47ab7c13 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.929325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86a08-7de5-4938-a89f-914c47ab7c13 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.929812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef86a08-7de5-4938-a89f-914c47ab7c13 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.931989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 374/742] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:31.936871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2493f4-6b43-43ac-ab78-b9cbec99d8e6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.937752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2493f4-6b43-43ac-ab78-b9cbec99d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.940012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:31.940012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.940376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.940463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.940788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2493f4-6b43-43ac-ab78-b9cbec99d8e6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.941304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:31.941613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:31.943478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068cd64-7b94-489c-bb2f-e4eab4bc3b69 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:31.943985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 375/743] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:31.945558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.946056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.946550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.964709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 369/744] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:31.966393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:31.966863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:31.967338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:31.976133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:31.977671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:31.990317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 376/745] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:31.991310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.002289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:32.003795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:32.011997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e04c26-1be6-41d4-ac18-42ce8785f89a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.014561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 370/746] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 15 04:07:32.015542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.021048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.022290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.022917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.023536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.025164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.025939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daada5-6607-4eac-9061-8b4756625fe2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.027657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:32.027657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:32.027657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:32.030388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.030663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.031307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.031588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.031917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.041433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.043520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.053957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 371/747] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:07:32.060963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.061206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 377/748] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:31 2022] POST /identity/v3/services => generated 251 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:32.061206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.071837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368feb0-d75e-4621-86cd-ee46229b348a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.090545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.092066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.092604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.093108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.106749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:32.114566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:32.116325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 372/749] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:32.117368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.128108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743454d-57f8-4976-aa1a-90454bc2ecd5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.129216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e31424-2373-4753-aa30-8d9426b197c2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.134319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.135565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.135903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.136273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.140034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.142357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.143764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.144516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.146275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.149753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.151994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.154982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.176439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:32.184461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 373/750] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:32.184461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.184928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 378/751] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:32 2022] POST /identity/v3/services => generated 240 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:32.189920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.206414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165cae0-ec71-4188-a242-c516680fe07d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.222889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.223886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.224204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.224586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.225563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.226025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.227852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.235941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08409d91-c673-48ce-aa44-cfdefe5b91a6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.238966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 374/752] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.246127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.256766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.257815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d038d-c4bd-4bb6-90aa-66cf6cdde673 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.259260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.260362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.261217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.262924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.263787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.268053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.274263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.275344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.275734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.276172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.295563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 379/753] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.302571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.305127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.306345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.326593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:32.332601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 375/754] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:32.333929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.338831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572096e5-bc54-4da1-9f82-ced07c9300c9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.352057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd97370-9123-4ddd-aeb2-4f084053c360 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.354740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.355930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.356323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.356708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.367875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.368826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.369234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.369738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.370565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.371021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.372128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.373025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.379514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.389148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 376/755] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.395692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.408637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b21ed-8aa2-4b7c-9df4-33e5af431c87 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.411730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:32.414386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.415572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.415825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 380/756] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:32.416005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.421076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.427055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.430493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.432730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.445102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f7fb9-40d9-4f3b-9df8-c74a062cbcf6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.453815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:32.455004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 377/757] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:32.456817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.458012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.458520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.459022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.460610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.461242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.461719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.465013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.473355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ff01-8bef-4523-8552-e6e990ec8e5f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.478757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.479653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.480044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.480423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.482417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.482863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.486651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.489177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 381/758] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.499449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.508727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 378/759] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:32.515251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.519343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a674f7-7fc0-48de-810b-83cd02370b1b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.527262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.528179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.529267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.529700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.530718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=d4d68bfed8d44a77a98bb887be0efd05) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.531526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.534458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.535675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62d5ce-ec1e-47a3-95f8-4b98f09f59f8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.541772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 382/760] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/role_assignments?user.id=d4d68bfed8d44a77a98bb887be0efd05&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.550826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.552051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.552497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.552944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.567300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.569581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.590957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:32.592808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 379/761] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:32.599421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.610638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd2079-7e01-46a3-90dc-9d4f9e28c40e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.616387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.617410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.617899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.618324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.619273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.619737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.621627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.636015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 383/762] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:32.642525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.653423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd0fe5-ebfb-48d8-b3aa-622f14fdf7cc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.659288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.660401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.660885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.661339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.669823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.672145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.687665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:32.690511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 380/763] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:32.696380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.707915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe7f2-6ccd-43b7-a6b0-3d4d3f420ff4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.717657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.718677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.719166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.719594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.721279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:32.721782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.724165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8679a-e04d-40f6-8dcf-a345ce58cc0c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.741937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 384/764] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:32.748184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:32.760821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c004a5-190e-4324-9c37-75e424afae5e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:32.766291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:32.768207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:32.768692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:32.769153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:32.771711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=f839e77bd3ad430d96b6957d398ec04a, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:32.774842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c389794-4dac-4487-88be-e1088d352c47 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:32.803287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 381/765] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:32 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:33.545558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d0c2-1ea0-4ac3-ab39-2da39ba7eef6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:33.546421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d0c2-1ea0-4ac3-ab39-2da39ba7eef6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:33.546883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d0c2-1ea0-4ac3-ab39-2da39ba7eef6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:33.549711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 385/766] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:33.557322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:33.558162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:33.558589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:33.583461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:33.584995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:33.648707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 382/767] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:33 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:33.714601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d0c2-1ea0-4ac3-ab39-2da39ba7eef6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:33.747473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d0c2-1ea0-4ac3-ab39-2da39ba7eef6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:33.762069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:33.763459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:33.763964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:33.764451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:33.788712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:33.803289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:33.805882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 386/768] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:33.814411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:33.828926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55e72e-70b4-4541-af36-6dce92042cb1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:33.846169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:33.847165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:33.847614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:33.848103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:33.849127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:33.849612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:33.851440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:33.861941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 383/769] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:33.868492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:33.896005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1fa1-e5fc-4993-8289-4bf99d91dcda admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:33.908199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:33.909792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:33.910434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:33.911049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:33.930349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:33.934076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:33.965558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:33.968316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 387/770] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:33.974406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:33.990895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd72d9-02d2-4593-b1e5-0dd28608b457 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.000264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.001338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.001935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.002401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.003316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:34.003929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.005793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.027890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 384/771] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:34.034401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.061286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6fd7b-d3e7-4e26-b0bf-2c7f1fcc69d8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.074767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.076192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.076799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.077454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.098185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.102661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.134643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:34.142466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 388/772] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:34.147860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.163275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8cfad-1fd4-4d0b-aef3-83e151d2389d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.177820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.178750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.179188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.179610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.180614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:34.181121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.183136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.207995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 385/773] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:34.214071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.241259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e340286-26a5-47d0-9969-d3a3a9f6e9ba admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.256313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.257947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.258581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.259202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.288630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.292388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.337498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:34.340280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 389/774] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:34.346111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.362874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb76cd-3337-4d12-bf02-9247e00aa320 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.377746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.378677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.379112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.379531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.380426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:34.380948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.382721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.396359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 386/775] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:34.402824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.432780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e92551-a933-4501-b349-a3481f2b8111 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.445920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.447489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.448123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.448748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.466257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.468502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.489634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:34.491134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 390/776] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:34.497128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.507807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80877255-6504-4963-8b99-84c96e5d163f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.521695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.522629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.523065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.523490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.524454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:34.524958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.526992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd536-5f42-47fd-95fd-14b32e8554a2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.541451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 387/777] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:34.547681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:34.573732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac852e32-5fff-4a08-9fc0-8d2bd10cbcc1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:34.590271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:34.591767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.592224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.592708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/72749c07825e430e9ca092a0bead2bda/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:34.627613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=72749c07825e430e9ca092a0bead2bda, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:34.633193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd237c-3e9a-402d-a39e-30872f600829 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:34.670405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 391/778] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:34 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/72749c07825e430e9ca092a0bead2bda/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:34.998875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faf5a4-0a5b-4e28-9d67-b9fe6c0dbfb0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:34.999552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faf5a4-0a5b-4e28-9d67-b9fe6c0dbfb0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:34.999552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faf5a4-0a5b-4e28-9d67-b9fe6c0dbfb0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.002368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 388/779] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:35.008317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.008678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.008986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.029523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:35.030715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:35.096451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 392/780] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:35 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:35.121815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faf5a4-0a5b-4e28-9d67-b9fe6c0dbfb0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.136188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faf5a4-0a5b-4e28-9d67-b9fe6c0dbfb0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.140852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.141751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.142189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.142666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.143467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.144504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:35.144504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:35.144504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:35.145435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.160020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 15 04:07:35.161613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 389/781] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/services/network => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:35.167642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.177698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bc6a-3935-4afa-aa74-f904e0694428 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.182534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.183212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.183548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.183826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.184605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:35.184924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.186651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.194816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 393/782] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:35.202439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.228086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da392c-94ad-4451-82c1-f3bb7a97ad0d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.244831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.246124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.246635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.247116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.248679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] RBAC: Adding query filter params (type=network) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:35.249337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.253155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.269297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 390/783] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:35.278519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.292266 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b084d8-65cf-4b62-9d4d-b0416287be83 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.302800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.303538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.303818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.304092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.304999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] RBAC: Adding query filter params (interface=public, service_id=505d0cb440834bc2bfde9d72409abf71, region_id=RegionOne) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:35.305369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.306490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:35.306490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:35.306490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:35.307453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908eea-ebf8-4249-af78-6b40eceb34e2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.320623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 394/784] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/endpoints?service_id=505d0cb440834bc2bfde9d72409abf71&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:35.329602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.354389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10abb7e-8958-4ef5-ad88-95ef3208f11d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.371227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.372435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.372970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.373470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.374796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.378497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fe214-f6bf-43ec-aefc-9a9c3ea56491 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.395071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 391/785] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/services => generated 772 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:35.799345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095a99-5291-4b05-aca4-b90c2dd368fd None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.800184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095a99-5291-4b05-aca4-b90c2dd368fd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.800184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e095a99-5291-4b05-aca4-b90c2dd368fd None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.802336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 395/786] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:35.811798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1cae-9c9a-4291-b168-5f6cdcd55904 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.812289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1cae-9c9a-4291-b168-5f6cdcd55904 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.812760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1cae-9c9a-4291-b168-5f6cdcd55904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.855215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9e1b1cae-9c9a-4291-b168-5f6cdcd55904 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:35.857226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9e1b1cae-9c9a-4291-b168-5f6cdcd55904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:35.875327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 392/787] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:35 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:35.919876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e095a99-5291-4b05-aca4-b90c2dd368fd None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:35.929343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133298cd-2d1e-4f6e-b261-e80e49f6685c None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.929343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133298cd-2d1e-4f6e-b261-e80e49f6685c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.929343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133298cd-2d1e-4f6e-b261-e80e49f6685c None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.929343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 393/788] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:35.936946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.936946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.936946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.946498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e095a99-5291-4b05-aca4-b90c2dd368fd None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:35.954081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:35.955496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:35.955978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:35.956463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:35.957809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:35.960259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:35.960935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:35.962028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:35.972327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 394/789] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:35 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:35.994119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 15 04:07:35.996734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 396/790] 10.222.0.45 () {56 vars in 1150 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:35.997385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.006643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.009235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed3bd8-9548-4c64-84c0-2cb9978307fc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.015047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.016272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.016876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.017430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.026167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcba486-3503-461e-934c-883d78a663cd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.030544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:36.034626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.035841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.036396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.036932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.038298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.038851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.039270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:36.040699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 395/791] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:36.044739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.046548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.057325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cea6c-b38f-4069-806a-4e05ed84593a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.062220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.062888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.063172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.063479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.063901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 397/792] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.064271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.064579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.066259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.073205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.080949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 396/793] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.082580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.092759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea2d75-2703-411e-83bb-8915a1271a21 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.098347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.099254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.099446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.099723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.108917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e39d2c-8220-4db4-81da-6802d8c129f1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.111912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.113951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.121167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.121872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.122160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.122432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.123180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.123466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.125126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cc0f6-845b-462c-a09c-c48eaf9f4c9e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.131071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 398/794] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.132520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bb09-7231-45e8-aa00-5ec7b6ddefb3 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.132809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bb09-7231-45e8-aa00-5ec7b6ddefb3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.132929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:36.133123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250bb09-7231-45e8-aa00-5ec7b6ddefb3 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.134423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 397/795] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:36.139327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 399/796] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:36.139752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.141293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.141661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.141980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.150409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39eec52-26cf-416c-9f5c-b756889bffd0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.155415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.156152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.156434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.156768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.158196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] RBAC: Adding query filter params (interface=public, service_id=8f8aa94b82a540a2ad09d035d2d33392, region_id=RegionOne) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.158509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.159584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:36.159584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:36.159584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:36.160511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.161643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:36.162995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:36.169697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 398/797] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/endpoints?service_id=8f8aa94b82a540a2ad09d035d2d33392&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.170606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.176972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 400/798] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:36 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:36.178560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.182711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ff92f-bef4-4998-9f0b-e36311d0b822 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.187743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.189131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.190205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.190205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.190712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.191022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.192770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.199081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987e7d5-51f2-479d-a8f4-94d680332875 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.206992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.207179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 399/799] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.208044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.208469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.208883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.209788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.212956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.213737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.223514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288170f1-1d4a-40e9-abf1-619acba3cdcd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.226207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 401/800] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/services => generated 772 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.227332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.228701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.229633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.229923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.230204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.238856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01aad-4f86-460c-a218-0ac84b36d45d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.239829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.242125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.244248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.245288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.245716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.246131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.259036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:36.260127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:36.261803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 400/801] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:36.267880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:36.268093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.274704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 402/802] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:36.276309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.278909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301f73-f5a1-4453-b47a-21d437bcbbd6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.291793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf7f0f-4b42-44f1-86af-47dae30b6094 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.294045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.295003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.295460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.295735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.297053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.297521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.302890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.308600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.311456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.314184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.314537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.315432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.315753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.319240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.343647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 403/803] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:36.344322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 401/804] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.350566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.352482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.370438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c1c3-af21-40a0-8dcd-c78a1bb15455 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.372747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1063eb-1e95-45ba-b871-9117a2b1135f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.382528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.383631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.384435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.384716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.385691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.385971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.386359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.387357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.412103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.414407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.416600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.417183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.440656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:36.442370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 402/805] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:36.448329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.456939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:36.463125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 404/806] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:36.468845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e060255-e4c2-4398-8716-18984285a637 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.470208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.481695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.482569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.482981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.483360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.484251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.484670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.487720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.491854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739164a-959f-4543-8b5d-fbdb4e6c8a63 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.503861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 403/807] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.510935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.511698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.511985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.512264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.512484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.513186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.513500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.515399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.526455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca09d60-0757-4be0-a684-cb2793ce0eae admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.544307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.544623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 405/808] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:36.546943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.551400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.563006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:36.565245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 404/809] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:36.572772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.578195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d1782-8316-465a-af2f-6667ec021836 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.585743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c57a43-8954-4981-9df0-70331ed22859 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.589027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.590622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.590872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.591170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.591539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.591767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.591868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.592084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.592927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.593258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.596042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.612236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 405/810] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:36.618731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.619230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.623797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.630548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a24478-14ba-447e-a794-f3d75f427b61 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.636069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.637033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.637323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.637605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/d4d68bfed8d44a77a98bb887be0efd05/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.640348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=d4d68bfed8d44a77a98bb887be0efd05, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.644067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.654973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:07:36.657950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 406/811] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:36.666204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.672484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 406/812] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:36 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/d4d68bfed8d44a77a98bb887be0efd05/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:07:36.680371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842e55-74b2-4b67-bdd0-835e4bfb1326 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.765063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.765672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.765957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.766288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.767344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:36.767747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.769690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.807414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 407/813] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:36.810138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.835838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5d20-b4d7-4c3b-add1-6c868d4220cc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.850947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.851628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.851917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.852196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.869455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.871292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.888404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 407/814] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:07:36.895255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.911475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaff0db-1482-456b-a905-e2a4f01e52f5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.921870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.922719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.923570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.923855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.941831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:36.944582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:36.968838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:36.971074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 408/815] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:36.977138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:36.990913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465e6f9-2d88-443c-a165-f985d1b3ec22 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:36.997721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:36.998425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:36.998758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:36.999039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:36.999796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:37.000105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:37.001867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:37.020314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 408/816] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:37.025922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:37.038492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6b216-2858-4a66-b9e2-f63048a772ab admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:37.043713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:37.044600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.044889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.045191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.053699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:37.055808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:37.071112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:37.072715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 409/817] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:37.080225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:37.098970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199768a-0a35-4783-a943-64705750afd3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:37.107432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:37.109103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.109898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.110729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.112656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:37.117637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:37.121274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25f30c-cee3-4cc8-a49c-02b039217673 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:37.148807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 409/818] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:37.155046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:37.173664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f999676-ee27-407c-bfa2-a4ebeed085a0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:37.181711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:37.182479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.182832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.183150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.184014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:37.184388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:37.186377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14fdb4-c5f0-435c-b922-f7c51201a76b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:37.198373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 410/819] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:37 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:37.799608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a251-6f05-44e1-be56-691840a74967 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.800132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a251-6f05-44e1-be56-691840a74967 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.800648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a251-6f05-44e1-be56-691840a74967 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.804625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 410/820] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:37.811767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.812285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.812745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.850255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:37.851528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:37.861635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 411/821] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:37 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:37.889115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a251-6f05-44e1-be56-691840a74967 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:37.916119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a251-6f05-44e1-be56-691840a74967 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:37.930291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:37.931807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:37.932319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:37.932832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:37.959659 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:37.978724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:07:37.980777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 411/822] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:07:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:37.988032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.004531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcb127-d640-41da-99d2-f500d7403bad None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.018734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.019533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.019833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.020117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.020998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.021320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.023153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.038738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 412/823] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:07:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:38.045354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.076476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73605175-607e-421b-b6eb-578b14468658 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.085265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.086661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.087147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.087650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.109508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.114115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.142785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:38.144450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 412/824] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:38.150906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.183242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7edc96-1a28-4368-b9fc-072782f17a65 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.191940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.193152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.193668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.194169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.195460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.196009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.199125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.223194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 413/825] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:38.229175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.240120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de788bd-3936-4e90-87d3-79dbef4fd7c5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.245311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.246168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.246453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.246729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.255360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.257561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.273912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:38.275504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 413/826] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:38.280863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.298984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d197f0-6c9d-4d2c-a27e-dc3705ff1343 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.309347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.310364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.310853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.311464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.312540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.313095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.316213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.347825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 414/827] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:38.353890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.383100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb860b-1d90-4573-b7fd-4453f19b00d0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.391254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.393061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.393561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.394150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.418467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.421877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.444986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 414/828] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:07:38.450908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.471544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945ea22-483c-440c-a9f1-e5322d460526 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.487896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.488638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.489001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.489317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.509500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.511793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.536807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:38.538109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 415/829] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:38.544577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.566976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1130cb6c-6c11-4854-8169-a61399a6fb68 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.582476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.583704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.584202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.584757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.586102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.586686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.589683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.611873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 415/830] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:38.617486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.634377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f841c-1035-4838-8c3d-97183d1d3151 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.652321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.653670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.654154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.654633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.682956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.686908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.724932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:38.729229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 416/831] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:38.737155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.763060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331525ee-f086-4323-953d-4f886bdf5e6d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.789943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.790996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.791466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.791938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.793422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.793963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.797481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6820a15-97fd-49c9-9ecb-4786fc6718dc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.834844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 416/832] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:38.841704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:38.873078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297b14f-d1d8-4d4b-9b3e-2e3152cd10af admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:38.894081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:38.895180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:38.895679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:38.896157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:38.897819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=72749c07825e430e9ca092a0bead2bda) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:38.898465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:38.902145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4461e0-e81c-453c-8150-01314173d863 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:38.917900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 417/833] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:38 2022] GET /identity/v3/role_assignments?user.id=72749c07825e430e9ca092a0bead2bda&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:39.249283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffdabb-fb62-4238-b7e8-f71584c53cbf None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.249836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffdabb-fb62-4238-b7e8-f71584c53cbf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.250236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffdabb-fb62-4238-b7e8-f71584c53cbf None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.253691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 417/834] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:39.263736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.264215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.264697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.295863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:39.298469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:39.312975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 418/835] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:39 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:39.357014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffdabb-fb62-4238-b7e8-f71584c53cbf None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.378102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffdabb-fb62-4238-b7e8-f71584c53cbf None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.384722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.386186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.386615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.387025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.388068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.390807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.412071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 15 04:07:39.414582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 418/836] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:39.424416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.439837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f59f-7655-44e8-9238-c9b7228aae8a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.447000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.448109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.448543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.449023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.450275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:39.450797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.453649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db9481-6770-4059-8ec0-9736639bdc72 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.463140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 419/837] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:39.471662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.488635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cf97b-59e3-4b33-b437-0c1f8a6a9a66 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.495865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.496984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.497459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.497921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.499170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:39.499731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.503130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.512886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 419/838] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:39.520013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051556f-6d95-4942-9368-03874129876c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.520489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051556f-6d95-4942-9368-03874129876c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.521010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051556f-6d95-4942-9368-03874129876c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.521182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.524447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 420/839] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:39.534537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b2e5b-3ac8-4704-8d11-fdb99c16d9b6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.534838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.535136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.535616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.540567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.541424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.541711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.541990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.542907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.543979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:39.543979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:39.543979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:39.545124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.570002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:39.571315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:39.586036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 420/840] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:07:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:39.607022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 421/841] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:39 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:39.657761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.675057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e647a-49b0-42f7-b826-6e5a80fccca5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.685871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.687348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.687866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.690228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.691694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.695308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.722754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 15 04:07:39.729191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 421/842] 10.222.0.45 () {56 vars in 1150 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:39.731229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.749661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaa68a-5f58-49cc-abda-27a596583c13 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.766390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.767562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.767842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.768125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.768868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:39.769198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.770822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.781800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 422/843] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:39.788867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.810457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeca059-01be-4ef5-8b4b-e88a3caffed3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.823987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.827720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.828052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.828332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.829178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:39.829493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.831157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849dd6d-24fe-4a16-9d3f-7c5e552cb908 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.840125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 422/844] 10.222.0.45 () {56 vars in 1145 bytes} [Tue Feb 15 04:07:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:39.846307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:39.858714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1b6e2-7aeb-401b-b7af-88d7454e4348 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:39.866931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:39.867621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:39.867914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:39.868193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:39.869004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:39.870061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:39.870061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:07:39.870061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:07:39.870984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942e324-adca-45f6-802f-1f4ae4e0f5b1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:39.908029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 423/845] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:07:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:40.344196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b555d1-3474-41ed-aa4b-bb7a2ff68c2c None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.345459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b555d1-3474-41ed-aa4b-bb7a2ff68c2c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.346250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b555d1-3474-41ed-aa4b-bb7a2ff68c2c None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.350061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 423/846] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:40.359315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.360769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.361599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.394639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:40.397611 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:40.430136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 424/847] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:40 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:40.455003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b555d1-3474-41ed-aa4b-bb7a2ff68c2c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.477559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b555d1-3474-41ed-aa4b-bb7a2ff68c2c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.485639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.487110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.487700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.488247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.509318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:40.523766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:07:40.526221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 424/848] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:40.531937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.542556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92797c45-bd19-45e3-9cee-bb3b80e2c2af None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.548735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.549974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.550513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.551006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.552055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.552600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.554512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.566067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 425/849] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:40.572269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.583930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5eb41-f529-4881-97b9-b6ef3f12e110 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.589310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.590404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.590957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.591462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.607984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.612346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.645929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-ce0e7df5-147d-4d0d-b3ef-283f9900a6db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:40.648413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 425/850] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:40.654093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.665794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67868-0ecf-4281-9585-0e75933a9568 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.671251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.672399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.673592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.674128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.675197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.675736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.677849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.684287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dac6e-155a-4f9d-9586-8cb5a3770e10 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.684659 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dac6e-155a-4f9d-9586-8cb5a3770e10 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.684836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dac6e-155a-4f9d-9586-8cb5a3770e10 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.687055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 426/851] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:40.693330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.693736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.693913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.696930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 426/852] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:40.703043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.713789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b2b0f-27c9-4ecf-a9e3-17b24734b1d6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.715270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:40.716419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:40.724294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.725314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.725602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.725929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.729932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 427/853] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:40 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:40.738948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.741504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.757744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.757958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 15 04:07:40.759756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 427/854] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:40.767128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.768687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0e052-bd3e-47e0-a24b-eeccefe2c6ed None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.773918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.775085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.775085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.775384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.776023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.777880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.779556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fba78-9ed6-4567-a4c8-3b83fa62a9f6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.785719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.786704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.787186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.787677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.788855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.789391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.791346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 15 04:07:40.791688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.797195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 428/855] 10.222.0.45 () {56 vars in 1153 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:40.799308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.809896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7b521-16b8-4f1b-b766-b1f8f4f92fda admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.813099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 428/856] 10.222.0.45 () {56 vars in 1156 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:40.818258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.818258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.818258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.818258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.818669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.818669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.819646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.820401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.825446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 429/857] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:40.831905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d5d1c-9d99-436b-a74c-91bb331c6722 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.832202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.837229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.838137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.838638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.838997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.842953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7dda3-e560-44e2-a26e-f8d7d61d6376 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.848727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.849799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.850271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.850378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.851223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.852150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.852276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.852767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.854649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.869057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 429/859] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:07:40.870627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.870840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 430/859] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:40.881528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28adab2-8bf9-4f8b-a824-c3d9ec176f31 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.892201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.893607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.894077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.894495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.907361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.909909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.930818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:40.932759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 430/860] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:40.938989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.950704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedac17-e175-4f01-be0d-caa806eaa577 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:40.957008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:40.957996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:40.958474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:40.958904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:40.959879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:40.960356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:40.962324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:40.979596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 431/861] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:40.986438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:40.999714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff9d2-91f0-4df4-91f8-398c89783e44 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:41.011296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:41.012422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:41.012926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:41.013391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:41.023344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:41.025995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:41.042756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:41.044864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 431/862] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:41.052547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:41.068047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512ad88-e6cd-45cd-9594-74341cd882ad admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:41.074706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:41.075745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:41.076259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:41.076746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:41.077834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:41.078355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:41.081574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285a1cc-0da2-4631-b4ec-04f588a574b1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:41.098066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 432/863] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:41.105379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:41.125544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0698bca2-4ee3-4cae-b52b-670870e963cd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:41.134436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:41.135844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:41.136336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:41.136822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:41.138500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=d4d68bfed8d44a77a98bb887be0efd05) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:41.139056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:41.143281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a6303-8a47-4169-b83a-8e5a825acf8a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:41.152595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 432/864] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:41 2022] GET /identity/v3/role_assignments?user.id=d4d68bfed8d44a77a98bb887be0efd05&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:42.179131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53694-0081-4ccb-8166-9209db37e6f2 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.179645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53694-0081-4ccb-8166-9209db37e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.179746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53694-0081-4ccb-8166-9209db37e6f2 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.181617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 433/865] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:42.187437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.188865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.189379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.208413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:42.210024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:42.218451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 433/866] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:42 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:42.244394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d53694-0081-4ccb-8166-9209db37e6f2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.266771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d53694-0081-4ccb-8166-9209db37e6f2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.274599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.276002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.276492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.277070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.297085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:42.312299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:07:42.315629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 434/867] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:42.321213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.331263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742b488-2d10-41cd-9fe6-2b96cc1bf37f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.336246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.337222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.337721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.338226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.339215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.339739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.341599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.351649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 434/868] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:42.358113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.377546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ade5b0-0948-4bd0-a8b0-d0887293aeaf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.385360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.386734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.387235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.387736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.407383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.411034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.443683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:42.446179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 435/869] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:42.452337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.470746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b053-617d-4d8f-91f9-d19d1a53f1f8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.478352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.479512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.480025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.480545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.481968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.482522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.485966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.509550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 435/870] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:42.518814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.534718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2786c-b8fc-449f-bb8a-bc8c2f685282 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.539978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.541202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.541688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.542113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.552450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.555037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.572239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:42.574129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 436/871] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:42.580777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.594889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da4d07-1b2d-414a-9c61-ae401d1f461b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.600186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.601100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.601496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.601920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.602931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.603348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.605439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.627846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 436/872] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:42.637450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.656219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bbe74-f107-43bd-aa15-cb09f80dd4b6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.665132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.666617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.667298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.668006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.685268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.689622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be8bbd-862f-46a1-9c55-0b79f02ad981 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.708853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 437/873] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:07:42.723692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.734468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f11eb-4557-4669-b24f-8f0eb806a623 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.740594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.741822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.742321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.742804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.759180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.761914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.782694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:42.785109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 437/874] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:42.788863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcde8-1dd0-4709-9ac2-f386e4731215 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.789336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcde8-1dd0-4709-9ac2-f386e4731215 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.789759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bcde8-1dd0-4709-9ac2-f386e4731215 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.793016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 438/875] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:42.793655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.802939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.803429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.803897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.808277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1c01-2985-4928-8fd5-bfe4bc53c0d0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.814714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.815196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.815457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.815701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.816453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.816821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.818666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.840945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 438/876] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:42.841188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:42.841188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:42.845423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.850361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 439/877] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:42 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:42.866105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f4310-172d-44cd-bac1-4c0471681563 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.874195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.876631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.877339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.877997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.878400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.894205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.894609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d2236-f983-4916-96d8-8123a2785922 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.898716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.901839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.903290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.903771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.904245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.905584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.909292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.929053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:42.930921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 15 04:07:42.936929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 440/879] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:42.937158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 439/879] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:42.940417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.942453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.952685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26ef1d-cf15-4bcd-9856-7daa1f9d32fe admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.960124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.960124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.960473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.960602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.961335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.961648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.963307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.969029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 441/880] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:42.971001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5584c-3ffc-4f7c-a971-1e1351668a1e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.975916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:42.981086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.983667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.984420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.986375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.988119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.988592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28f114-66f2-4af1-bd96-86e8c97326d7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:42.989241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.993755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214433d-6bcc-4073-b599-0e944ffd47f9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:42.993931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:42.994663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:42.995050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:42.995386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:42.996226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:42.996594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:42.998364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:43.010220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 442/881] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:43.025148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 440/882] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:43.029999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:43.050062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102f13e-dbee-435c-b64b-eec63ec6bea9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:43.059070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:43.060812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:43.061679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:43.062389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:43.065241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] RBAC: Adding query filter params (role.id=8873a7cd27b142efbb8a953244b51d12, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=72749c07825e430e9ca092a0bead2bda) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:43.066118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:43.070238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f7dd0-dbf2-4e40-bee1-b12dbe638070 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:43.089139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 443/883] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:43 2022] GET /identity/v3/role_assignments?user.id=72749c07825e430e9ca092a0bead2bda&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=8873a7cd27b142efbb8a953244b51d12 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:44.286808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508885-8eac-42e8-9fa5-ddb153254a05 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.287331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508885-8eac-42e8-9fa5-ddb153254a05 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.287772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d508885-8eac-42e8-9fa5-ddb153254a05 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.291577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 441/884] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:44.301240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.301761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.302222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.333221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:44.335221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:44.349206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 444/885] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:44 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:44.389871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d508885-8eac-42e8-9fa5-ddb153254a05 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:44.412668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d508885-8eac-42e8-9fa5-ddb153254a05 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:44.420629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:44.422094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.422652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.423160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.424458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:44.427665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:44.450285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 15 04:07:44.457052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 442/886] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:44.463243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:44.480254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c893e8-b083-4177-b3b7-4364056f9e38 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:44.488518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:44.489638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.490083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.490542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.491889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:44.492424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:44.495526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25555763-6d65-4e25-85e3-0b428802584c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:44.504508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 445/887] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:44.513759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:44.532600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79b1b0-5e04-452c-b831-dafd1379f9df admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:44.540647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:44.541759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.542252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.542736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.544110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:44.544653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:44.548399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c7cf-a299-403b-a213-c0965c0b38f3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:44.557487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 443/888] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:44.587586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf05f0-b31f-4f68-8c8c-3a7ce1c3276d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.587977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf05f0-b31f-4f68-8c8c-3a7ce1c3276d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.588401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf05f0-b31f-4f68-8c8c-3a7ce1c3276d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.591813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 446/889] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:44.599031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0f1b-7999-4d1b-9ae7-103e5043213f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.599469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0f1b-7999-4d1b-9ae7-103e5043213f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.599899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0f1b-7999-4d1b-9ae7-103e5043213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.625269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-997a0f1b-7999-4d1b-9ae7-103e5043213f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:44.627619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-997a0f1b-7999-4d1b-9ae7-103e5043213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:44.636555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 444/890] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:44 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:44.675822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf05f0-b31f-4f68-8c8c-3a7ce1c3276d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:44.699638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf05f0-b31f-4f68-8c8c-3a7ce1c3276d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:44.707783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:44.709064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:44.709679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:44.710294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:44.711856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:44.713939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:07:44.713939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:07:44.713939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:07:44.715760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b969e2f-7a1c-4958-aa78-5225fa06f75e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:44.746245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 447/891] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:44 2022] POST /identity/v3/services => generated 269 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:45.835216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ca79c-bc5f-4596-aabc-a8c249286ded None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.836097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ca79c-bc5f-4596-aabc-a8c249286ded None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.836257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ca79c-bc5f-4596-aabc-a8c249286ded None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.840134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 445/892] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:45.849078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661382-a5e9-453a-854e-690ff6ce33e5 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.849807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661382-a5e9-453a-854e-690ff6ce33e5 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.849807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661382-a5e9-453a-854e-690ff6ce33e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.869464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6f661382-a5e9-453a-854e-690ff6ce33e5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:45.870650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6f661382-a5e9-453a-854e-690ff6ce33e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:45.889532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 448/893] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:45 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:45.894042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdbc92-6ec1-44f9-92fb-11cd7f1f82a0 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.894410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdbc92-6ec1-44f9-92fb-11cd7f1f82a0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.894668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbdbc92-6ec1-44f9-92fb-11cd7f1f82a0 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.896629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 446/894] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:45.902186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.902573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.902891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.921338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:45.922680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:45.928812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdbc92-6ec1-44f9-92fb-11cd7f1f82a0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:45.931645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 449/895] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:45 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:45.951416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbdbc92-6ec1-44f9-92fb-11cd7f1f82a0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:45.955981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:45.958899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:45.960035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.960524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.961039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.962422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:45.965310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5cfb8-7014-4681-a7a5-44833fcddca8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:45.965643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:45.970896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:45.971706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:45.972421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:45.972769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:45.986803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:45.993779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 447/896] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:45 2022] POST /identity/v3/services => generated 251 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:45.994970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:07:46.001493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 450/897] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:07:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:46.003176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.027827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02809cd-5fb2-4f0d-a1c3-28d917bd1101 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.033107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.033862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.034146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.034420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.035249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:46.035568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.037265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.052208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 448/898] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:46.053683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.064552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aef4bb-6b1f-4a10-adcf-6f7fdcc7d94c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.069694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.070557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.070835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.071107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.084714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.086735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.105642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:46.112464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 451/899] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:46.113962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.124935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee37032-dd8f-47e2-a6e2-48000c83907b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.130921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.131627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.131942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.132217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.133133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:46.133442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.135405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.154623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 449/900] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:46.156110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.167177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2b24f-2e70-4e0d-9d43-b5e3b686b975 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.172124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.173586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.173855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.174087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.183701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.185906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.201973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:46.205020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 452/901] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:46.210423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.222186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903d63f-1cf6-4d6f-8d45-f47f0c785dfa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.227308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.227958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.228245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.228563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.229531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:46.229839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.231800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.259060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 450/902] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:46.261352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.276782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abca7f-9c3f-47b0-9fc2-1d38a94b2962 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.289751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.290545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.290827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.291093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.305333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.307619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.326902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:46.329370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 453/903] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:46.335058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.346176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87fe38-ae5a-4993-bc74-9ed18ecc1aab admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.350937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.351705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.351988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.352258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.353085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:46.353387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.355061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.373882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 451/904] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:46.377311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.387577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775b337-71ef-4c00-8b14-c9a57fd60756 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.392847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.393932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.394416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.394887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.403037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.405358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.420320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:46.422193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 454/905] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:46.428433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.438692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1a126-9913-4372-8f67-a9c9656a99a8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.443284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370625-f699-4830-944d-133f01606973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.444010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370625-f699-4830-944d-133f01606973 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.444291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370625-f699-4830-944d-133f01606973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.444616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370625-f699-4830-944d-133f01606973 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.445456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370625-f699-4830-944d-133f01606973 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:46.445764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370625-f699-4830-944d-133f01606973 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.447664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370625-f699-4830-944d-133f01606973 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.466767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 452/906] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:46.468139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:46.480960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b5d17-24b3-41bc-ba24-a77b887fcc1b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:46.486660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:46.487828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:46.488281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:46.488969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/72749c07825e430e9ca092a0bead2bda/roles/8873a7cd27b142efbb8a953244b51d12` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:46.491590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=72749c07825e430e9ca092a0bead2bda, role_id=8873a7cd27b142efbb8a953244b51d12)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:46.494513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ad3e-722f-493d-9cf1-9725ca71850b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:46.513113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 455/907] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:07:46 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/72749c07825e430e9ca092a0bead2bda/roles/8873a7cd27b142efbb8a953244b51d12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:07:47.104022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c3b-e4d6-478f-9d5d-993b2dd5257e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:47.105098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c3b-e4d6-478f-9d5d-993b2dd5257e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:47.105588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c3b-e4d6-478f-9d5d-993b2dd5257e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:47.107899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 453/908] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:47.114305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd06a-f364-4fff-b09e-f87215e13e86 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:47.114787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd06a-f364-4fff-b09e-f87215e13e86 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:47.114904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fd06a-f364-4fff-b09e-f87215e13e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:47.134437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d75fd06a-f364-4fff-b09e-f87215e13e86 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:47.135871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d75fd06a-f364-4fff-b09e-f87215e13e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:47.197020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 456/909] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:47 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:47.221592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72c3b-e4d6-478f-9d5d-993b2dd5257e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:47.234615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72c3b-e4d6-478f-9d5d-993b2dd5257e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:47.240270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:47.241001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:47.241340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:47.241609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:47.242399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:47.244039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e63e21-0bd5-416f-991f-f0d4a174862f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:47.260806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 454/910] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:47 2022] POST /identity/v3/services => generated 241 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:48.665212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8f90-1d0b-434b-bca3-720521726104 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.665787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8f90-1d0b-434b-bca3-720521726104 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.665787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8f90-1d0b-434b-bca3-720521726104 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.667950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 457/911] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:48.674990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.675511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.675511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.695233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:48.696451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:48.715243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 455/912] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:48 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:48.746127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8f90-1d0b-434b-bca3-720521726104 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:48.766264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8f90-1d0b-434b-bca3-720521726104 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:48.771755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:48.772574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.772849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.773153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.773957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:48.777103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:48.790216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 15 04:07:48.791449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 458/913] 10.222.0.45 () {56 vars in 1153 bytes} [Tue Feb 15 04:07:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:48.798367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:48.814539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe8026-ace6-4f08-ba0b-5a685988dcc1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:48.819574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:48.820248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.820506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.820776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.821554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:48.821860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:48.823495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:48.830101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 456/914] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:48.838287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:48.849500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44c4be-edea-42bc-ba58-0159909531b9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:48.854287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:48.854942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.855220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.855491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.856209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:48.856511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:48.858126 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:48.864646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 459/915] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:48.870469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:48.881782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739569f-ad9c-47b5-9edf-297396e64259 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:48.886824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:48.887477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.887758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.888044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.888974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] RBAC: Adding query filter params (interface=public, service_id=1704bf7e95be4bb48d105d93edda3605, region_id=RegionOne) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:48.889166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:48.890720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45d197-904c-4e45-a8aa-708d231348e1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:48.897666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 457/916] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:48 2022] GET /identity/v3/endpoints?service_id=1704bf7e95be4bb48d105d93edda3605&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:48.903035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:48.914395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b909cd8-38e1-4c79-a7b3-d2938d94fdc4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:48.919241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:48.919886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:48.920166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:48.920525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:48.921273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:48.923591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfdd71-c913-4072-a14f-cc960474cbe1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:48.930917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 460/917] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:48 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:07:49.020671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195689-d357-4846-9637-bbb174dee3e2 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.020671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195689-d357-4846-9637-bbb174dee3e2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.020671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f195689-d357-4846-9637-bbb174dee3e2 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.020671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 458/918] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:49.031055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.032742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.033536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.068022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:49.070440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:49.088978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 461/919] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:49 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:49.126426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f195689-d357-4846-9637-bbb174dee3e2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.148029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f195689-d357-4846-9637-bbb174dee3e2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.155717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.158061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.158744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.159420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.160865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.164086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.185941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 15 04:07:49.197371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 459/920] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:49.199751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.217343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59ca5b-0449-43a7-84df-176d05e3c257 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.226681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.228298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.229030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.229730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.231340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:49.232068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.235384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.249381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 462/921] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:49.254757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.273229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d979e-9a94-4e51-a929-9f9e64e36374 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.281425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.284161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.284921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.285578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.287151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:49.287943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.291556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.309084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 460/922] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:49.311991 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.331368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e7f5f-352b-4d30-892e-df906fb65259 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.339732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.341196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.341932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.342614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.344639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] RBAC: Adding query filter params (interface=public, service_id=6771fde968ee40de9c25a3fa3693676f, region_id=RegionOne) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:49.345437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.348761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6dcea-b827-4de7-8b84-d78cc2bb4511 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.365000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 463/923] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/endpoints?service_id=6771fde968ee40de9c25a3fa3693676f&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:49.369168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.387844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79734c3-1a34-4536-90d4-034fdfbb8518 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.395921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.397359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.398016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.398619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.400025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.403017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181d554-2a71-4570-806d-a4962e436f1f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.421126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 461/924] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services => generated 1497 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:07:49.746540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962db1a-b7e0-45d1-8beb-ffd81c4226cd None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.747367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962db1a-b7e0-45d1-8beb-ffd81c4226cd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.747367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962db1a-b7e0-45d1-8beb-ffd81c4226cd None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.749450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 464/925] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:49.756088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb3fa-8386-4041-b90f-376506c03b9e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.756858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb3fa-8386-4041-b90f-376506c03b9e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.756858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdb3fa-8386-4041-b90f-376506c03b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.777908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cbfdb3fa-8386-4041-b90f-376506c03b9e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:49.779260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cbfdb3fa-8386-4041-b90f-376506c03b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:49.789697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 462/926] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:49 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:49.815072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962db1a-b7e0-45d1-8beb-ffd81c4226cd None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.844096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962db1a-b7e0-45d1-8beb-ffd81c4226cd None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.853218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.854596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.855080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.855558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.856791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.859751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.860442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5e7a-4f02-47fa-90f5-9e86f6b56113 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.860718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5e7a-4f02-47fa-90f5-9e86f6b56113 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.861222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d5e7a-4f02-47fa-90f5-9e86f6b56113 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.864691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 463/927] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:49.873896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.874345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.874787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.882512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 15 04:07:49.885260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 465/928] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:49.892883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.903253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:49.905310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:49.911812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522019a8-d3a3-495c-ae06-2ac744392883 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.918575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 464/929] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:49 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:49.919877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.921174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.921715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.922200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.924257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:49.924946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.928228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.940547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 466/930] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:49.946775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.959434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e39ff-282d-4dbd-960b-9e0e72e69c61 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.963597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.965321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.966337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.966865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.967369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.968319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:49.968830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:49.970962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:49.978194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 465/931] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:49.983294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a688d-3d5c-45ba-9b0b-ca11ec6130c9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:49.984830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:49.990421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:49.991745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:49.992218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:49.992679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:49.998367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2bea7-6102-43ab-a61d-e06c3c607842 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.004969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.006238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.006731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.007629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.008737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] RBAC: Adding query filter params (interface=public, service_id=1657a54ce7494983a186231da042e2e3, region_id=RegionOne) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.009397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.011586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.013278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:07:50.018965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 466/932] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/endpoints?service_id=1657a54ce7494983a186231da042e2e3&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:50.024988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.028524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:07:50.035793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 467/933] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:07:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:50.037801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.041319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf3439-70fa-48bc-b4da-ad7fae04aa42 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.046513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852808-4579-4911-b732-e288ae388271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.048303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852808-4579-4911-b732-e288ae388271 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.048871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852808-4579-4911-b732-e288ae388271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.049375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852808-4579-4911-b732-e288ae388271 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.050890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16852808-4579-4911-b732-e288ae388271 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.053128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16852808-4579-4911-b732-e288ae388271 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.056580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388524f1-78ab-42f8-af0b-8e696f068cc4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.067959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 467/934] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/services => generated 1497 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:07:50.071724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.072818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.073414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.073888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.075395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.075974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.079964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.097854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 468/935] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:50.104061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852808-4579-4911-b732-e288ae388271 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.122999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852808-4579-4911-b732-e288ae388271 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.132154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.133694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.134193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.135042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.156493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.160824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.195878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:50.198665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 468/936] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:50.206079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.217507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767a8dd-42f3-4f9c-9345-99fd0cba1cdf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.223932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.225228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.225836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.226328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.227386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.227973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.230142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.246767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 469/937] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:50.253812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.265356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304fde2-1257-4dff-b413-cee04729fdbc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.271801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.273320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.273883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.274363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.284464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.287117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.304875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 15 04:07:50.306846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 469/938] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:50.313966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.331936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf5f3a-8fcf-4355-88cf-36db4a33e177 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.337047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.337964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.338236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.338517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.339471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.339787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.341838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.364544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 470/939] 10.222.0.45 () {56 vars in 1170 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:50.370252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.386244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1755db5-8aeb-4918-b3ff-ce084707897e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.394698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.395817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.396404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.396888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.412117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.415463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.433021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 470/940] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/auth/tokens => generated 1765 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:07:50.439534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.457462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77f8c-b04a-4ed1-9abf-847d4d6510c2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.465170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.466597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.467084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.467569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.488457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.491889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.524449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:07:50.527224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 471/941] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:50.533029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.542594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be805f5e-aaba-4ca9-abd2-58ae8fccd3b9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.547264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.548462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.548745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.549156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.549900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.550206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.551805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.565633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 471/942] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:50.571076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.582206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b60f251-3a8d-4d2b-949e-20bb5b28697e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.586955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.587798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.588125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.588408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.597278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.599257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.614596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:50.616170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 472/943] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:50.622002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.632860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0182c5-da44-41ed-91c9-d7170a96b197 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.637993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.638677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.639015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.639276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.640159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.640636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.643192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90164299-7123-4a74-9272-cc45efcd30bc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.660926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 472/944] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:50.667032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:50.678664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48976ca-4f35-4363-a6cd-680a21f2bc22 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:50.683426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:50.684140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:50.684470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:50.684749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:50.685676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] RBAC: Adding query filter params (role.id=8873a7cd27b142efbb8a953244b51d12, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=72749c07825e430e9ca092a0bead2bda) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:50.685985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:50.687958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292b726-5003-4d12-b45f-64aa03763d79 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:50.696107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 473/945] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:07:50 2022] GET /identity/v3/role_assignments?user.id=72749c07825e430e9ca092a0bead2bda&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=8873a7cd27b142efbb8a953244b51d12 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:51.832944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb04c-7f34-4b4c-b9d9-84b84d6ffb2f None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:51.834035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb04c-7f34-4b4c-b9d9-84b84d6ffb2f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:51.834035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2eb04c-7f34-4b4c-b9d9-84b84d6ffb2f None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:51.837988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 473/946] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:51.848341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:51.849402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:51.849402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:51.881553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:51.883524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:51.905048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 474/947] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:51 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:51.937539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eb04c-7f34-4b4c-b9d9-84b84d6ffb2f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:51.961119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2eb04c-7f34-4b4c-b9d9-84b84d6ffb2f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:51.968566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:51.970825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:51.971291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:51.971771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:51.973086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:51.975810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:51.997156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 15 04:07:52.005076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 474/948] 10.222.0.45 () {56 vars in 1153 bytes} [Tue Feb 15 04:07:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:52.010721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.026544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab97203-06cf-4acb-928a-d56ba221e70d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.034857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.035962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.036522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.037031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.038451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:52.039092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.042056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.055889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 475/949] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:52.060629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.078129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cacdd1-4e2c-4068-becf-5eeb8f83edc4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.086597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.087765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.088295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.088769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.090223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:52.090751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.093762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac6a01-55ff-4056-a064-bb07f0b3ecad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.104515 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 475/950] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:52.114077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.131084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667d98c-a325-4379-b0da-4e5df837aebf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.139481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.141706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.142656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.143419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.145067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.148181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e35ce-b8ed-437d-b787-f58afc13f449 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.183179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 476/951] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:07:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:52.249697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7091-1418-40c7-8203-e7f9cc68cb1f None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.250120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7091-1418-40c7-8203-e7f9cc68cb1f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.251184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7091-1418-40c7-8203-e7f9cc68cb1f None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.254635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 476/952] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:52.260446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.260939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.261356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.290628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:52.292863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:52.322188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 477/953] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:52 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:52.346885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7091-1418-40c7-8203-e7f9cc68cb1f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.361213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7091-1418-40c7-8203-e7f9cc68cb1f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.365987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.366820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.367106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.367385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.368073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.369783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.383050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 15 04:07:52.384973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 477/954] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:52.391448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.402052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96250e28-bcfb-45c6-9db5-f3180b61f1ab None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.408077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.408881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.409238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.409514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.410281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:52.410687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.412481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.418719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 478/955] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:52.425723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.440192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b98a-040e-4770-b408-42e1519599c8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.446806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.447506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.447788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.448065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.448822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:52.449183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.450872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2be4a0-93fb-4558-925f-24e662a90567 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.457804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 478/956] 10.222.0.45 () {56 vars in 1135 bytes} [Tue Feb 15 04:07:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:52.463538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:52.480413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d11162-07f3-4fdf-ab7f-d9bd86c29abb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:52.487260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:52.487932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:52.488213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:52.488486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:52.490544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:52.491057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f595f6-fcd1-4b39-b3b7-d3fc3715e897 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:52.530998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 479/957] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:07:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:07:53.122531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0a50-446b-4560-b552-6280b9362bf5 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.123385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0a50-446b-4560-b552-6280b9362bf5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.123385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a0a50-446b-4560-b552-6280b9362bf5 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.125944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 479/958] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:53.131921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.132745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.132745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.161480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:53.163948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:53.198141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 480/959] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:53 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:53.221748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0a50-446b-4560-b552-6280b9362bf5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:53.234617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a0a50-446b-4560-b552-6280b9362bf5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:53.239835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:53.240719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.241120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.241459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] PATH_INFO: `/v3/services/image` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.242196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:53.243873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:53.258384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 15 04:07:53.260245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 480/960] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Feb 15 04:07:53 2022] GET /identity/v3/services/image => generated 86 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:53.266677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:53.276261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d77ce9-297e-4fa6-bcce-f01189a01767 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:53.281182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:53.282371 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.282655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.282923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.283754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:53.284059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:53.285734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132808f-d715-4628-a431-a125523d0850 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:53.291724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 481/961] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:53.297884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:53.308343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392a10-94c6-4898-87d6-28fb0cc5655b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:53.313935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:53.314711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.315020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.315305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.316066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:53.316377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:53.318098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f528c14-6f1f-436e-aa32-ad2a4b2fd8d3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:53.323779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 481/962] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:53.807659 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5e0ae-dc3a-4e2b-8d3f-a873c78203ca None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.808160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5e0ae-dc3a-4e2b-8d3f-a873c78203ca None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.808658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5e0ae-dc3a-4e2b-8d3f-a873c78203ca None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.814566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 482/963] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:53.822289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.822799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.823295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.854820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:53.856844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:53.877057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 482/964] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:53 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:53.916661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5e0ae-dc3a-4e2b-8d3f-a873c78203ca None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:53.939842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5e0ae-dc3a-4e2b-8d3f-a873c78203ca None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:53.947702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:53.949230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:53.949788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:53.950422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:53.951705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:53.955881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:53.979555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 15 04:07:53.988962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 483/965] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:53.993457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:54.010828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803b357-3cde-46c6-960a-b48c031dcbf9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:54.019345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:54.020531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:54.021060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:54.021546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:54.022991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:54.023542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:54.026707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:54.037261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 483/966] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:54.047883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:54.065848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff313b-d1b6-4976-b435-54c6e6675ffb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:54.073581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:54.074707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:54.075210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:54.075705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:54.077082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:54.077641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:54.081560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474ebf2-0810-46c6-8f7e-588ee943ffc2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:54.097072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 484/967] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:54.101588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:54.120314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b0767-e76f-47dd-906b-df0d59523205 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:54.129393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:54.130604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:54.131108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:54.131672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:54.133239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:54.136867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f721ea7-4eb9-4b5a-b4a4-7d1202683412 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:54.180363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 484/968] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:07:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:55.111359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e17f-a60e-4179-9bf8-ace507970ebd None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.112047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e17f-a60e-4179-9bf8-ace507970ebd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.112047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606e17f-a60e-4179-9bf8-ace507970ebd None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.113917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 485/969] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:55.119897 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.120183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.120453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.139738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:55.141518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:55.160128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 485/970] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:55 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:55.185690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606e17f-a60e-4179-9bf8-ace507970ebd None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:55.207131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606e17f-a60e-4179-9bf8-ace507970ebd None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:55.214816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:55.215915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.216390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.216869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.218180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:55.221944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:55.223893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.common [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 15 04:07:55.252627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.sql.core [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 15 04:07:55.252627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 15 04:07:55.252627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [parameters: {'id': 'f6d1a7b7305e4ef093c51ab652e0ba06', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 15 04:07:55.252627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79226) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 15 04:07:55.282683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6d1a7b7305e4ef093c51ab652e0ba06.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6d1a7b7305e4ef093c51ab652e0ba06. Feb 15 04:07:55.285668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 486/971] 10.222.0.45 () {60 vars in 1161 bytes} [Tue Feb 15 04:07:55 2022] POST /identity/v3/projects => generated 262 bytes in 101 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:55.291232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:55.301385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cced201-a04c-4a79-9baf-6824f93600b3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:55.306113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:55.306922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.307208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.307482 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.315184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:55.317243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:55.332219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-bc57849e-eecc-44b9-84ef-dda81cd2bf2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:07:55.333871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 486/972] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:55.340169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:55.351886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95a75a-38aa-42db-aca5-3b5da5f30198 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:55.356766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:55.357488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.357772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.358052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.358861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:55.359173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:55.362102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cd73a-ddc0-4885-86be-212ecb9172cf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:55.389598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 487/973] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:55.667849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d1e1-01e3-4c10-b067-d7c09a54ae5b None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.668193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d1e1-01e3-4c10-b067-d7c09a54ae5b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.668480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536d1e1-01e3-4c10-b067-d7c09a54ae5b None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.670646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 487/974] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:55.677890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8283-4adb-451b-9d53-7321be5fe340 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.678575 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8283-4adb-451b-9d53-7321be5fe340 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.679091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8283-4adb-451b-9d53-7321be5fe340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.704523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a3ba8283-4adb-451b-9d53-7321be5fe340 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:55.706564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a3ba8283-4adb-451b-9d53-7321be5fe340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:55.715563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 488/975] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:55 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:55.745603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536d1e1-01e3-4c10-b067-d7c09a54ae5b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:55.765652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536d1e1-01e3-4c10-b067-d7c09a54ae5b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:55.771396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:55.772483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:55.773024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:55.773551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:55.774561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:55.776449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dd8fe-f8fd-44c5-8ff2-02022f890f5d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:55.793346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 488/976] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:55 2022] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:07:56.296319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f806-89ea-4121-8d02-52cc2fc2f606 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.296876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f806-89ea-4121-8d02-52cc2fc2f606 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.298506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f806-89ea-4121-8d02-52cc2fc2f606 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.302253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 489/977] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:56.311118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.311752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.312388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.342619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:56.346058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:56.385094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 489/978] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:56 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:56.419094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f806-89ea-4121-8d02-52cc2fc2f606 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:56.441321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f806-89ea-4121-8d02-52cc2fc2f606 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:56.448698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:56.450007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.450449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.450896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.452071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:56.455891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:56.483742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 15 04:07:56.493081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 490/979] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:07:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:56.497205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:56.514905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa772-22da-40d0-b5a2-b112dfd0e79b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:56.523281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:56.524424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.524992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.525471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.526832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:56.527391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:56.530522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdd769-373b-4f3c-abdb-9dacfd4804ab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:56.549216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 490/980] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:56.552166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:56.571913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0643-8021-4889-9d07-979d41cbee3d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:56.580589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:56.581793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.582278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.582771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.584113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:56.584674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:56.587810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42328ed1-c16c-4f9e-a122-a4ed85e76651 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:56.605098 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 491/981] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:07:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:56.843666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23702-246b-4c9a-9b61-2a9ea38e7b46 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.843862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23702-246b-4c9a-9b61-2a9ea38e7b46 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.844672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe23702-246b-4c9a-9b61-2a9ea38e7b46 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.846543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 491/982] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:56.852536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.853014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.853394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.875134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:56.877182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:56.886014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 492/983] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:56 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:07:56.910325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe23702-246b-4c9a-9b61-2a9ea38e7b46 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:56.932516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe23702-246b-4c9a-9b61-2a9ea38e7b46 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:56.937596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:56.938947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.939409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.939693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.940363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:56.942016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:56.954568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 15 04:07:56.956138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 492/984] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:56.962966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:56.980017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b68db-06df-41ab-b567-4f010b9e1903 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:56.989107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:56.990673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:56.991426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:56.992204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:56.993882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:56.994785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:56.998445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:57.009490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 493/985] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:57.017031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:57.027421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269145-0bc4-4e9c-937e-50b52881cf0c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:57.033639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:57.034646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:57.035079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:57.035525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:57.036472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:57.036975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:57.039032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:57.045458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 493/986] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:57.051878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:57.063275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8516b6d-a2b3-4f45-bdae-f008d2d0d47a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:57.068607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:57.069511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:57.070001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:57.070437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:57.071405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] RBAC: Adding query filter params (interface=admin, service_id=1657a54ce7494983a186231da042e2e3, region_id=RegionOne) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:57.071918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:57.073757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b2d1e-5e16-4e27-997b-31f81f4baa5b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:57.080298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 494/987] 10.222.0.45 () {56 vars in 1270 bytes} [Tue Feb 15 04:07:57 2022] GET /identity/v3/endpoints?service_id=1657a54ce7494983a186231da042e2e3&interface=admin®ion_id=RegionOne => generated 193 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:57.086141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:57.097451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f0902-557a-4f6c-a759-6c0978ed1b94 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:57.102667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:57.103591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:57.104050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:57.104534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:57.105411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:57.107289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d932-26d5-4c08-839c-8d4dd9f54719 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:57.115037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 494/988] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:57 2022] GET /identity/v3/services => generated 1727 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:07:58.598781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d3f1-41e7-42a0-bfec-4f2b51c752bd None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.599582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d3f1-41e7-42a0-bfec-4f2b51c752bd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.599582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d3f1-41e7-42a0-bfec-4f2b51c752bd None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.601370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 495/989] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:58.607030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.607762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.607762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.627291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:58.628477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:58.637185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 495/990] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:58 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:58.659348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd118-f578-4ca9-965b-3f4cae8db312 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.659631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd118-f578-4ca9-965b-3f4cae8db312 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.659922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd118-f578-4ca9-965b-3f4cae8db312 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.662006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 496/991] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:07:58.675894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.676089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.676089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.676089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.688753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804efce-a932-449f-9f3b-08e6f02b93d5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.694168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:58.695654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:58.696369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.697552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.698042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.698661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.699956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.704083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.705554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 497/992] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:58 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:58.712929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.common [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 15 04:07:58.727604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.sql.core [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 15 04:07:58.727604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 15 04:07:58.727604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [parameters: {'user_id': '3ca03129d03f4fa8ade8d85751b15e39', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 15 04:07:58.727604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79225) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 15 04:07:58.735326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.740943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 15 04:07:58.745086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 496/993] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:07:58 2022] POST /identity/v3/users => generated 160 bytes in 73 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:58.751505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda24c-b152-4aa9-932a-f2f0dc7df48e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.753726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.763374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.764923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.765483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.766442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.768242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.771404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.774732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf6a8f-c2d7-4ec7-8377-e8239924559b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.782890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.784588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.785400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.786801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.787241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 15 04:07:58.789094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 498/994] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:58.798435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.801749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.803993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.816238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784fdf3-eb3a-44a2-b02b-38f1d6aee446 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.818503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 15 04:07:58.824718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 497/995] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:07:58.826114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.828064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.830121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.830928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.831677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.833345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:58.834174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.837507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.842458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b38df7-9702-4edc-bdbd-970fc896e1a4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.853115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 499/996] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:58.856318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.856318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.856318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.856318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.857675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.858370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:58.858676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.861168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.881843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47442bca-6745-42e0-9e37-3b0df5833071 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.892171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.893808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.894603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.895429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.898180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:58.899088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.902825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.909041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 498/997] 10.222.0.45 () {56 vars in 1122 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:58.913829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 500/998] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:58.923996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.935059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf296c01-88e6-41df-ac11-8e1c6106f73c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.941297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.942308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.942861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.943345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.944352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] RBAC: Adding query filter params (interface=public, service_id=3b10997a8690446e8659c467d7fbc636, region_id=RegionOne) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:58.944855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.946842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84522e-ce37-4739-8cf6-8d6f6c0e98c4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:58.953565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 499/999] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/endpoints?service_id=3b10997a8690446e8659c467d7fbc636&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:07:58.963174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:58.981709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bc15d-2afe-421c-92f8-56f1943f780c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:58.990753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:58.992186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:58.992683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:58.993266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:58.994634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:58.997920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7b92f-525c-42ec-8ade-cc3cd6e29c8e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:59.013436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 501/1000] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:07:58 2022] GET /identity/v3/services => generated 1727 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:07:59.770614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca6a6-b579-4d6e-8e1f-d2464fd44803 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.771323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca6a6-b579-4d6e-8e1f-d2464fd44803 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.771323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bca6a6-b579-4d6e-8e1f-d2464fd44803 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.773333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 500/1001] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:59.779039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ff11-a91a-46f6-9d09-2d5810279c4d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.779818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ff11-a91a-46f6-9d09-2d5810279c4d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.779818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ff11-a91a-46f6-9d09-2d5810279c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.807958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-28e9ff11-a91a-46f6-9d09-2d5810279c4d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:59.810069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-28e9ff11-a91a-46f6-9d09-2d5810279c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:59.825122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 502/1002] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:59 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:59.867132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bca6a6-b579-4d6e-8e1f-d2464fd44803 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:59.891691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bca6a6-b579-4d6e-8e1f-d2464fd44803 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:59.892310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc20a-16d7-43a5-bfd9-6953a399ccc9 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.892603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc20a-16d7-43a5-bfd9-6953a399ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.892884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc20a-16d7-43a5-bfd9-6953a399ccc9 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.894794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 503/1003] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:07:59.900431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:59.900714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.901011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.901289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.902361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.902880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.903385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.904688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:59.908458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:59.921680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:07:59.923493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:07:59.932091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 504/1004] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:07:59 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:07:59.933396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 15 04:07:59.935809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 501/1005] 10.222.0.45 () {56 vars in 1147 bytes} [Tue Feb 15 04:07:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:07:59.946373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:59.956247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:07:59.964068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff44a-5b5c-4d89-872e-302bdd434001 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:59.972680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:59.973887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.974387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf63ea-d2cd-4af6-95ea-e4e147ceffe2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:07:59.974556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.974884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.976272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:07:59.976834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:59.980086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:59.982091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:07:59.983490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:07:59.983700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:07:59.984194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:07:59.987000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:07:59.990032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:07:59.995007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 505/1006] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:07:59.997489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:00.013480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 502/1007] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:07:59 2022] POST /identity/v3/services => generated 242 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:08:00.025009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039a70f-1b3e-4de6-8784-ae51bffe080e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:00.050004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:00.051329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:00.051911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:00.052491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:00.054060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:00.054701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:00.058156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c4de9-3fd8-446e-b881-601b1b3f1a36 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:00.068682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 506/1008] 10.222.0.45 () {56 vars in 1143 bytes} [Tue Feb 15 04:07:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:00.077788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:00.095532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4507c-7f30-4fce-955b-d5304a0d31c2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:00.102852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:00.103979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:00.104524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:00.105086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:00.106409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:00.109220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b21ff-6158-4d07-8d19-5fbc0115139f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:00.137127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 503/1009] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:08:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:01.743374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830896-592f-45b4-ac1d-17b20e0d8f4a None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.744115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830896-592f-45b4-ac1d-17b20e0d8f4a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.744115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20830896-592f-45b4-ac1d-17b20e0d8f4a None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.745950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 507/1010] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:01.754385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.755151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.755297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.776791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:01.778380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:01.798418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 504/1011] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:01 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:01.821393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830896-592f-45b4-ac1d-17b20e0d8f4a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:01.834314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20830896-592f-45b4-ac1d-17b20e0d8f4a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:01.838950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:01.839765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.840044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.840317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.841037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:01.842713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:01.855498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 15 04:08:01.857366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 508/1012] 10.222.0.45 () {56 vars in 1126 bytes} [Tue Feb 15 04:08:01 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:01.864351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:01.874261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e7586-74d0-4827-9f5d-5f1441438f04 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:01.879787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:01.880462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.880727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.881045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.881793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:01.882099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:01.883774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:01.889852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 505/1013] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:01.895763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:01.905818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395be2f3-b779-477a-93e7-27635708dc70 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:01.910910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:01.911590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.911867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.912124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.912888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:01.913216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:01.914867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b018dcd-852b-43ba-b8d3-e7785388c993 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:01.920527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 509/1014] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:01.927292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:01.944462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d3070-f56e-4647-ad73-6da89c05bbb8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:01.952238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:01.954018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:01.954553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:01.955177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:01.956528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:01.959545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328966a6-e729-4d7b-a4a6-08820d854220 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:01.999318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 506/1015] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:08:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:08:02.460788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a321ee-d344-4a28-b21f-0eb389c48a8d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.461184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a321ee-d344-4a28-b21f-0eb389c48a8d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.461373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a321ee-d344-4a28-b21f-0eb389c48a8d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.463200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 510/1016] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:08:02.470941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735c1c-a1b0-4b81-9487-87d0456ca0ab None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.471440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735c1c-a1b0-4b81-9487-87d0456ca0ab None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.471925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735c1c-a1b0-4b81-9487-87d0456ca0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.493403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-32735c1c-a1b0-4b81-9487-87d0456ca0ab None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:02.494714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-32735c1c-a1b0-4b81-9487-87d0456ca0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:02.517915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 507/1017] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:02 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:02.555443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a321ee-d344-4a28-b21f-0eb389c48a8d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.575253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a321ee-d344-4a28-b21f-0eb389c48a8d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.580963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62429d-3f12-4fc2-93ab-0928f9eddd87 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.581259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62429d-3f12-4fc2-93ab-0928f9eddd87 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.581530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62429d-3f12-4fc2-93ab-0928f9eddd87 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.583530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.583730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 508/1018] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:08:02.584757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.585266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.585700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.586767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.589085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.589375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.589654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.590055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.609118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:02.610199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 15 04:08:02.610848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:02.613306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 511/1019] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:02.623624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.623826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 509/1020] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:02 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:02.641476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d01f-0289-4299-9029-509099eb5b05 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.644514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.648641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.649756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.650206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.650675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.651847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:02.652357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.654623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c11f0-e83c-4cc6-aa44-3e0279a704a4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.655215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.661145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.662205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.662698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.663151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.664322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 512/1021] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:02.664810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.666555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.668234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 510/1022] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:02.670958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.676116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.688249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89ec14-0cac-4299-affc-3e929b8651d6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.688606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a733c4-7213-4f25-b9d7-4e5dce2eaf66 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.693526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.694203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.694487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.694761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.695508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.695961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.697021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.697483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.697676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.697933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.699153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:02.699638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.702335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.711910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 513/1023] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:02.717707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.729456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429536e-d1e4-44ef-b68b-b23b7084e6e6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.741211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 511/1024] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:08:02 2022] POST /identity/v3/projects => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:08:02.741508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.741508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.741508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.741508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.742048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] RBAC: Adding query filter params (interface=public, service_id=4cf1ffb0b9574866ae936b78693a6863, region_id=RegionOne) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:02.742048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.742048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d9e13-7379-4e56-bc82-0dbdcabbebac admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.746276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 514/1025] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/endpoints?service_id=4cf1ffb0b9574866ae936b78693a6863&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:02.756345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:02.835687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eba5d8-9abf-46a0-82bb-403f236cf7ac admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:02.841310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:02.842021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:02.842339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:02.842621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:02.843355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:02.845862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a92d5-1ade-489b-9abe-1b8b78e59ff9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:02.854114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 512/1026] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:08:02 2022] GET /identity/v3/services => generated 1957 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:08:04.469772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a367-cf17-406a-9903-ad194a19cc0e None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:04.470360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a367-cf17-406a-9903-ad194a19cc0e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:04.470884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48a367-cf17-406a-9903-ad194a19cc0e None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:04.474284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 515/1027] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:04.479965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819542df-963a-43d3-a887-25a57ae52648 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:04.480710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819542df-963a-43d3-a887-25a57ae52648 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:04.480710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819542df-963a-43d3-a887-25a57ae52648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:04.501244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-819542df-963a-43d3-a887-25a57ae52648 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:04.503304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-819542df-963a-43d3-a887-25a57ae52648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:04.513864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 513/1028] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:04 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:04.542650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a367-cf17-406a-9903-ad194a19cc0e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:04.563630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48a367-cf17-406a-9903-ad194a19cc0e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:04.570405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:04.571472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:04.572018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:04.572518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:04.588070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:04.591480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2fe8e-c22a-4042-80fb-657c7b503820 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:04.613015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 516/1029] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:04 2022] GET /identity/v3/auth/tokens => generated 2817 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:08:04.614697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819542df-963a-43d3-a887-25a57ae52648 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:04.624145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819542df-963a-43d3-a887-25a57ae52648 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:04.629890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:04.630687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:04.630965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:04.631233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:04.632459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:04.634190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac2688-044e-4b2f-a086-67f5570ac290 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:04.636293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 514/1030] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:05.197123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f636-0487-44dd-af86-c970c1079bc8 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.197498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f636-0487-44dd-af86-c970c1079bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.197836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3f636-0487-44dd-af86-c970c1079bc8 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.199687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 517/1031] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:05.209116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.209625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.210196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.228141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b4d3-c6dd-4c28-9d51-7590cc7fc817 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.228416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b4d3-c6dd-4c28-9d51-7590cc7fc817 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.228693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595b4d3-c6dd-4c28-9d51-7590cc7fc817 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.230588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 518/1032] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:08:05.237667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.237946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.238231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.241590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:05.243439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:05.256689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:05.257291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 515/1033] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:05 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:05.257992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:05.267141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 519/1034] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:05 2022] POST /identity/v3/auth/tokens => generated 2817 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:05.283742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.292026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.300235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70098b17-8e76-4236-9b78-a8ce64a05122 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.301485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9c4d-3892-48a8-8c51-9d4f6dd5f2b6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.306124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.306910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.307066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.307234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.307455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.307731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.308031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.308298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.308680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.309014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.310460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.310645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.312085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 520/1035] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:05.318640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.323121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 15 04:08:05.324348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 516/1036] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:08:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:05.329040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9271290-5ebc-4ae5-bce1-f37a53e8f593 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.332889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.334038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.334732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.334990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.335292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.335978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.337959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.343510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683d01e-5573-41e8-b236-1a0bdcce5a2b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.352667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.353491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.353792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.354251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.355387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:05.355734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.357421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.361665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 521/1037] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:08:05 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:08:05.363532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 517/1038] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:08:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:05.370134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.382025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fe34a-4dd4-40f2-b519-91ca5ab5c6fd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.387716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.388505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.389012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.389354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.390212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:05.390770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.392697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834b012-0bd5-43bf-985c-7d6e5f418d4e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.398707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 522/1039] 10.222.0.45 () {56 vars in 1133 bytes} [Tue Feb 15 04:08:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:05.405167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:05.416476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d49bc-5ba2-4038-8436-0c79cdb9f5e2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:05.421525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:05.422746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:05.423128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:05.423413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:05.424239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:05.425993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5da59f-170c-42ae-a93d-ffd07795d0da admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:05.450485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 518/1040] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:08:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:07.726757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc312-1cc9-42c6-a3b0-36bf23757cd1 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.727435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc312-1cc9-42c6-a3b0-36bf23757cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.727435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc312-1cc9-42c6-a3b0-36bf23757cd1 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.729080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 523/1041] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:08:07.735438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74707-b077-4913-9709-2fc9a2364eb5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.736187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74707-b077-4913-9709-2fc9a2364eb5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.736187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74707-b077-4913-9709-2fc9a2364eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.757051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-86c74707-b077-4913-9709-2fc9a2364eb5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:07.758265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-86c74707-b077-4913-9709-2fc9a2364eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:07.778588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 519/1042] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:07.803801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dc312-1cc9-42c6-a3b0-36bf23757cd1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:07.824808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dc312-1cc9-42c6-a3b0-36bf23757cd1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:07.832329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:07.833705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.834208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.834701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.853974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:07.867739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:07.869221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898345-6799-41e6-8fea-dd42cac5e90c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.869516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898345-6799-41e6-8fea-dd42cac5e90c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.869794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61898345-6799-41e6-8fea-dd42cac5e90c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.869940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 524/1043] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:07.871568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 520/1044] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:08:07.877491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:07.877925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.878230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.878468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.888578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea03db-14b2-4817-8e97-6c5b92dd58f2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:07.893317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:07.893981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.894262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.894537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.895311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:07.895617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:07.897471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:07.907209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 525/1045] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:07.911044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:07.912247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:07.913061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:07.924018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6ff7b-ac35-4890-b37c-84581e666193 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:07.925917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 521/1046] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:07.930516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:07.932049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.932535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.933064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] PATH_INFO: `/v3/users/7b133b79442d467f964aae36fa968d9a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.957020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:07.958113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b133b79442d467f964aae36fa968d9a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:07.962174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:07.965264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 526/1047] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:07 2022] GET /identity/v3/users/7b133b79442d467f964aae36fa968d9a => generated 285 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:07.971296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:07.972161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f89b6c-314b-404c-ac2b-800e3209a67e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:07.979478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:07.980702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.981211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.981645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.981803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3608b93-8b58-4f26-8681-fa6bf5223288 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:07.987224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:07.987870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:07.988151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:07.988430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:07.997403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:07.999237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.002658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:08.011445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 527/1048] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:08:08.017250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:08:08.017891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.019449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 522/1049] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:08:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:08.028824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.031248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c20a13-8e03-4165-a3b0-2ef5ba75bd7e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.036915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.037954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.038299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.038718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.040246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.041486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11286c-b6d2-430f-bc2e-4a4acf7d40e7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.042690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.044665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 528/1050] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:08.047849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.048690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.049143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.050060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.050748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.051199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.052212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.053243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.063580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 523/1051] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:08.064262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11261c09-daa1-471f-a046-b7034b2bb70c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.069677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.070135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.070979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.071354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.071728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.072714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=d0d3319f117b44dfb6bd1651735fac41, user.id=7b133b79442d467f964aae36fa968d9a) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.073157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.075341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.080728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267558bf-c2c1-40c0-925f-1ea0fee7e5f2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.082604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 529/1052] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/role_assignments?user.id=7b133b79442d467f964aae36fa968d9a&scope.project.id=d0d3319f117b44dfb6bd1651735fac41&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:08.085626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.086456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.086742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.087023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.100077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.102104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.122762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:08.124119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 524/1053] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:08.131139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.142700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d379074-4861-4bd2-a68b-b7c260c20891 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.147719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.148444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.148727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.149044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.149810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.150115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.151836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.170843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 530/1054] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:08.177616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.189389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6251aac-f01f-4dd8-b81b-4e24b27efdf4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.196971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.197839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.198124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.198404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.209793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.212034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.231810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:08:08.233021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 525/1055] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:08.239111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.249467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c736-0d82-4873-bb9e-03490069f08e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.254951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.255632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.255908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.256181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.257096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.257406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.259574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.282860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 531/1056] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:08.289078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.300218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda3323-a0a7-4ee8-a4fc-48ecd99b8e60 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.305190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.305837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.306121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.306399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.315966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.317761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.327220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 526/1057] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:08.333510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.343299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5fde19-3d34-445a-891b-81bd944df720 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.348362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.349177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.349461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.349735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.361209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.363124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.380155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:08.381417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 532/1058] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:08.387406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.396460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0fa3-3118-4381-a4e6-42e3a152db30 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.401037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.401694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.401977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.402254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.402978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.403281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.404866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.416966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 527/1059] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:08.423592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.433520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccd668-7f62-436e-8d8e-c7e116b22ff4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.438180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.438963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.439242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.439516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.446865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.448817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.461754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:08:08.462952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 533/1060] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:08.469344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.479330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec5224-1382-4cc0-93ec-4b2c0bb5c7c0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.489950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.490562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.491288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.491674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.492652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.493075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.495854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c13623-0c42-4d05-a523-f1b1a27e1f70 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.511065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 528/1061] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:08.517968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:08.529884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6239-0fbe-4867-a3a7-bd5cebc0909a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:08.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:08.535657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:08.535945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:08.536223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:08.537088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] RBAC: Adding query filter params (role.id=8873a7cd27b142efbb8a953244b51d12, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:08.537401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:08.539258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0eeeb0-b322-467b-9182-746b0319b024 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:08.545113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 534/1062] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:08 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=8873a7cd27b142efbb8a953244b51d12 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:10.368454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bfc-32f9-47ae-9c4d-8f2310fbb0ef None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.369061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bfc-32f9-47ae-9c4d-8f2310fbb0ef None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.369061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10bfc-32f9-47ae-9c4d-8f2310fbb0ef None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.370961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 529/1063] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:10.376623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.377119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.377375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.394846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:10.396032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:10.403724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 535/1064] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:10.430567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10bfc-32f9-47ae-9c4d-8f2310fbb0ef None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.443058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10bfc-32f9-47ae-9c4d-8f2310fbb0ef None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.447402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.448187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.448470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.448744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.459213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:10.466186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:10.467380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 530/1065] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:10.473967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.483139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462b79f-e97d-4013-abd5-9cf4cc21d8db None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.488758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.489515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.489795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.490068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.490832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:10.491136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:10.492728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:10.501783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 536/1066] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:10.507454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.518060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef9246a-31db-42c3-b7bc-55947f0209a9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.522536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.523384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.523665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.523937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] PATH_INFO: `/v3/users/7b133b79442d467f964aae36fa968d9a` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.525157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] RBAC: Authorizing `identity:get_user(user_id=7b133b79442d467f964aae36fa968d9a)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:10.527265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:10.528845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 531/1067] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:10 2022] GET /identity/v3/users/7b133b79442d467f964aae36fa968d9a => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:10.535212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.545325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf554c3-b2fc-4e1a-9c56-100c0547a446 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.550938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.551826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.552113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.552395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.553727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:10.555927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7215d4-ee8d-4a5b-bd5c-117725563f9d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:10.557794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 537/1068] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:10 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:10.564270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.575234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d67b60-6071-40e9-99c5-295037981246 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.580321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.581251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.581533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.581808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41/users/7b133b79442d467f964aae36fa968d9a/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.583808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d3319f117b44dfb6bd1651735fac41, user_id=7b133b79442d467f964aae36fa968d9a, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:10.586500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b440fca-5c72-4def-96ea-1f7dec9f5d0f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:10.601118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 532/1069] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:08:10 2022] PUT /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41/users/7b133b79442d467f964aae36fa968d9a/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:08:10.844576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e2c7-5d00-43d0-84eb-0db44e5c717e None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.844853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e2c7-5d00-43d0-84eb-0db44e5c717e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.845164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e2c7-5d00-43d0-84eb-0db44e5c717e None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.846940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 538/1070] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:10.852378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.852768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.853143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.871344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:10.872535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:10.931268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 533/1071] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:10 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:10.957027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849e2c7-5d00-43d0-84eb-0db44e5c717e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:10.969417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849e2c7-5d00-43d0-84eb-0db44e5c717e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:10.974289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:10.974929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:10.975214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:10.975499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:10.987203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:10.994944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:08:10.996193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 539/1072] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:08:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:11.003502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.013081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2898e221-9381-495d-b7bd-0753e2c48eeb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.018618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.019318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.019599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.019872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.020654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:11.021002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.022650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.032429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 534/1073] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:11.038842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.049462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcac303-fe46-4828-a247-8434cf55bbe2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.054211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.054993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.055268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.055540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.067272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.069145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.086440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:11.087626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 540/1074] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:11.093759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.103601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b3a6b-1a98-4c07-b37f-d9589dfd8807 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.108190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.108848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.109717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.110003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.110730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:11.111037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.112638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.126106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 535/1075] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:11.132103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.142322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96539a-e612-4ae3-964c-c37673939515 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.146901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.147687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.147968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.148245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.155901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.158787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.173179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:08:11.174570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 541/1076] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:11.180204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.190382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d4aeb-1f5a-4107-8957-f9429c789cad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.194975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.195649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.195927 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.196320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.197197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:11.197502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.199339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.217870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 536/1077] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:11.224146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.234959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9205ac9-445f-44b7-a87b-d1fb355c7710 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.239651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.240438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.240721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.241035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.252296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.254207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.272063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:11.273322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 542/1078] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:11.279698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.293946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be0a1-c0e3-4aa3-8417-cadcf21297b8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.307292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.307971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.308248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.308520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.309292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:11.309595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.311208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.323506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 537/1079] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:11.329338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.339547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe106de-8952-439e-ac6d-c58e1ed496c2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.345350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.346142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.346415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.346683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.354156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.356139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.370930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:08:11.372214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 543/1080] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:11.379055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.389854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81c287-2b64-4f51-9143-5f52deb00fd7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.396004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.396691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.397011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.397292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.398097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:11.398414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.400301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb00817-495b-41b0-860b-8c606845d446 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.414240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 538/1081] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:11.420844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:11.432033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161229-0351-40cd-ad89-bb5159287014 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:11.437076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:11.438467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:11.438756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:11.439029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/8873a7cd27b142efbb8a953244b51d12` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:11.441499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=f839e77bd3ad430d96b6957d398ec04a, role_id=8873a7cd27b142efbb8a953244b51d12)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:11.444216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88c043-6e9a-4fdb-854b-4c2ca077dff8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:11.460548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 544/1082] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:08:11 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/f839e77bd3ad430d96b6957d398ec04a/roles/8873a7cd27b142efbb8a953244b51d12 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:08:12.863732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d155bc-36e4-46b0-91b6-07f5f4bffef0 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:12.864257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d155bc-36e4-46b0-91b6-07f5f4bffef0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:12.864257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d155bc-36e4-46b0-91b6-07f5f4bffef0 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:12.866084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 539/1083] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:12.872294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:12.872733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:12.872826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:12.892274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:12.893477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:12.951267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 545/1084] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:12.975776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d155bc-36e4-46b0-91b6-07f5f4bffef0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:12.988383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d155bc-36e4-46b0-91b6-07f5f4bffef0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:12.993026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:12.993817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:12.994104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:12.994383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.005239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:13.012517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:13.013755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 540/1085] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:13.020529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.029810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20180902-aba2-4e91-a00b-ef67210e71f0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.034665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.035487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.035835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.036178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.037169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:13.037566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.039233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.048881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 546/1086] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:13.054777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.068011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a6d9c-14cb-4810-86d6-f1838af65a66 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.073430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.074488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.074760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.075043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] PATH_INFO: `/v3/users/7b133b79442d467f964aae36fa968d9a` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.076342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] RBAC: Authorizing `identity:get_user(user_id=7b133b79442d467f964aae36fa968d9a)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.079283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.081010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 541/1087] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/users/7b133b79442d467f964aae36fa968d9a => generated 285 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:13.087175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.097784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10038889-735f-47eb-a92c-ab8fc31ca2fd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.103635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.104258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.104538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.104810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.114567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.116346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.126998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 547/1088] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:13.132992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.143718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615f6f-54ce-4ff8-bdeb-cf3f3dae2b2d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.148367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.149263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.149551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.149831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.151021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.153100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8463ae-667e-4e03-bfec-c19a541b4de0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.154814 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 542/1089] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:13.161165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.170560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0dc93-83fa-4cf5-ab4e-6a2d4f014e3a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.176153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.176881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.177125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.177398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.178234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=d0d3319f117b44dfb6bd1651735fac41, user.id=7b133b79442d467f964aae36fa968d9a) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:13.178538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.180676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4779d70-ec33-44c6-b89d-8e600813a371 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.192437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 548/1090] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/role_assignments?user.id=7b133b79442d467f964aae36fa968d9a&scope.project.id=d0d3319f117b44dfb6bd1651735fac41&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:13.750487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b19c-b9fb-411a-9190-b7580666e65e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.750868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b19c-b9fb-411a-9190-b7580666e65e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.751279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5716b19c-b9fb-411a-9190-b7580666e65e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.754240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 543/1091] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:13.760420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44486-3761-44f0-930f-358141d1290a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.760705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44486-3761-44f0-930f-358141d1290a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.761019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44486-3761-44f0-930f-358141d1290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.778935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-dcf44486-3761-44f0-930f-358141d1290a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:13.782630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dcf44486-3761-44f0-930f-358141d1290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:13.787818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 549/1092] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:13.811943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716b19c-b9fb-411a-9190-b7580666e65e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.824932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5716b19c-b9fb-411a-9190-b7580666e65e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.829563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.830242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.830523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.830797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.848785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:13.856296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 15 04:08:13.857570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 544/1093] 10.222.0.45 () {56 vars in 1141 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:13.864319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44486-3761-44f0-930f-358141d1290a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.873326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44486-3761-44f0-930f-358141d1290a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.878943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.879610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.879888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.880162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:13.880951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:13.881254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:13.882854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:13.891945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 550/1094] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:13.897923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:13.908024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790bdf7-b329-4b2b-aa45-e0a568763800 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:13.912615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:13.913436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:13.913722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:13.914000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.046405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.048727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.066788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:14.068049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 545/1095] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:14.074088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.085364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0d9b6-5caa-4d73-a047-329aa3baf26a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.089939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.090611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.090891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.091164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.091905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:14.092210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.095041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.107876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 551/1096] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:14.114043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.123977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1166654-a795-4a61-bf66-06dd36617b3f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.129309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.130097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.130379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.130648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.138979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.141611 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.155159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 15 04:08:14.156401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 546/1097] 10.222.0.45 () {56 vars in 1114 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:14.162267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.172623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63b4fe-e60f-414e-b79f-b2a63ff18d06 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.177162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.177822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.178102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.178380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.179226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:14.179530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.181404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.200116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 552/1098] 10.222.0.45 () {56 vars in 1154 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:14.206424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.216216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcbf9-2724-4cc2-94d0-9ff763ed6c9f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.221130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.221766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.222046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.222316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.230281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.232025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.241050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 547/1099] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:14.247239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.260620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eef978-a508-4457-bed5-65e3299b7d4d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.265162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.267118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.267415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.267667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.278120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.279951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.298072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:08:14.299187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 553/1100] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:14.305151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.314567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142a12d-7916-4dfe-b17f-65606316318b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.319065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.319728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.319994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.320262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.321027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:14.321317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.322887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.335127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 548/1101] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:14.340801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.351401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca04acb-3691-42b4-a5db-74d46d47159a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.356028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.356815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.357137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.357415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.365982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.368028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.382031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:08:14.383256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 554/1102] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:14.389552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.399195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520215-0d49-4978-924c-fa05bcf917aa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.403649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.404288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.404583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.404839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.405657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:14.406494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.408311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7ab22-32a7-4841-b562-49c5aaef1ccf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.419909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 549/1103] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:14.426082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:14.436499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ae4f7-07b1-4181-86c6-23fc13df580c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:14.441525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:14.442149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:14.442428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:14.442705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:14.443528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] RBAC: Adding query filter params (role.id=8873a7cd27b142efbb8a953244b51d12, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=f839e77bd3ad430d96b6957d398ec04a) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:14.443832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:14.445688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73523cd0-d3c5-48c2-831f-a92143b57ad7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:14.451362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 555/1104] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:14 2022] GET /identity/v3/role_assignments?user.id=f839e77bd3ad430d96b6957d398ec04a&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=8873a7cd27b142efbb8a953244b51d12 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:15.491432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef942c-d4c7-4679-b038-e836d443e0d3 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:15.491999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef942c-d4c7-4679-b038-e836d443e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:15.491999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef942c-d4c7-4679-b038-e836d443e0d3 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:15.493789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 550/1105] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:15.499118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:15.499571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:15.500268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:15.520420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:15.521620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:15.529172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 556/1106] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:15 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:15.555390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef942c-d4c7-4679-b038-e836d443e0d3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:15.567440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef942c-d4c7-4679-b038-e836d443e0d3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:15.571772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:15.572545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:15.572826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:15.573128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:15.574294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:15.575968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03368511-887b-4952-bd49-1ccb3862f945 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:15.577553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 551/1107] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:15.583887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:15.592692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bbd6e-34b8-42bb-baec-ff8b9a3f1e73 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:15.598064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:15.598707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:15.598987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:15.599264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:15.599972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:15.601916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c041d3b-6299-46d8-936b-ff01d1983d49 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:15.621149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 557/1108] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:08:15 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:17.917958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ef13-c83d-4d93-a6c5-c5d6511b53c9 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:17.918544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ef13-c83d-4d93-a6c5-c5d6511b53c9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:17.918544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ef13-c83d-4d93-a6c5-c5d6511b53c9 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:17.920294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 552/1109] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:17.925661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:17.926120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:17.926239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:17.944472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:17.945702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:17.954262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 558/1110] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:17.978313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ef13-c83d-4d93-a6c5-c5d6511b53c9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:17.990272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ef13-c83d-4d93-a6c5-c5d6511b53c9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:17.994585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:17.995414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:17.995695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:17.995968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] PATH_INFO: `/v3/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:17.997457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] RBAC: Authorizing `identity:get_role(role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:17.998452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:08:17.998452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:08:17.998452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:08:17.999331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:18.001204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 553/1111] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:17 2022] GET /identity/v3/roles/6d733f44594041f5bbc6de2766346027 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:18.006963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:18.016868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7fadf-df10-4fb4-8af7-56c3e960a980 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:18.021471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:18.022313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:18.022592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:18.022866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] PATH_INFO: `/v3/users/240c44919463409e9baf8bc46d21c0d0` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:18.036156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=240c44919463409e9baf8bc46d21c0d0)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:18.038341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:18.039957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 559/1112] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:18 2022] GET /identity/v3/users/240c44919463409e9baf8bc46d21c0d0 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:18.045766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:18.055806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3606-bc2d-4dfb-b80b-3cd91d8b1707 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:18.060319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126987-0647-4477-8631-a1989f17174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:18.060983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126987-0647-4477-8631-a1989f17174a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:18.061271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126987-0647-4477-8631-a1989f17174a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:18.061546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35126987-0647-4477-8631-a1989f17174a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:18.069830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126987-0647-4477-8631-a1989f17174a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:18.071551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35126987-0647-4477-8631-a1989f17174a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:18.080766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 554/1113] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:18 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:18.086781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:18.096435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc3869-52b5-4d6f-8cac-5e2d1fa6fee2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:18.101018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:18.101854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:18.102138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:18.102415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:18.103599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:18.105678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394810b9-0081-4946-81ba-4e380072846a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:18.107335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 560/1114] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:18 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:18.113466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126987-0647-4477-8631-a1989f17174a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:18.122228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35126987-0647-4477-8631-a1989f17174a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:18.127328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:18.127961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:18.128244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:18.128520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:18.129396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=d0d3319f117b44dfb6bd1651735fac41, user.id=240c44919463409e9baf8bc46d21c0d0) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:18.129708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:18.131527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45f1f-f2e1-4ef9-8d6a-e3cc362a1315 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:18.137026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 555/1115] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:18 2022] GET /identity/v3/role_assignments?user.id=240c44919463409e9baf8bc46d21c0d0&scope.project.id=d0d3319f117b44dfb6bd1651735fac41&role.id=6d733f44594041f5bbc6de2766346027 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:20.337892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1011b-bb2d-4105-943c-5f1c512f7483 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.338448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1011b-bb2d-4105-943c-5f1c512f7483 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.338448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1011b-bb2d-4105-943c-5f1c512f7483 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.340194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 561/1116] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:20.346171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.346647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.346742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.364479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:20.365691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:20.373324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 556/1117] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:20.397503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1011b-bb2d-4105-943c-5f1c512f7483 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:20.410111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1011b-bb2d-4105-943c-5f1c512f7483 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:20.414451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:20.415277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.415557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.415831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] PATH_INFO: `/v3/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.417338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] RBAC: Authorizing `identity:get_role(role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:20.418348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:08:20.418348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:08:20.418348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:08:20.419224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:20.420534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 562/1118] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:20 2022] GET /identity/v3/roles/6d733f44594041f5bbc6de2766346027 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:20.426816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:20.435673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991078ba-378f-4548-8023-c861cd0c1f35 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:20.440188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:20.441086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.441367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.441641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] PATH_INFO: `/v3/users/240c44919463409e9baf8bc46d21c0d0` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.442851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] RBAC: Authorizing `identity:get_user(user_id=240c44919463409e9baf8bc46d21c0d0)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:20.445005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:20.446576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 557/1119] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:20 2022] GET /identity/v3/users/240c44919463409e9baf8bc46d21c0d0 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:20.452137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:20.461747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc9eb-89b5-49ba-af6f-569531ace315 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:20.466293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:20.467089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.467372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.467647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.469486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:20.471517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aba2a-bca3-4316-99f5-6ae4328dd1c6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:20.473197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 563/1120] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:20 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:20.478961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:20.489287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d35ce-d123-4758-bc30-31b5e09fed19 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:20.493772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:20.494641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:20.494924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:20.495199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41/users/240c44919463409e9baf8bc46d21c0d0/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:20.497423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d3319f117b44dfb6bd1651735fac41, user_id=240c44919463409e9baf8bc46d21c0d0, role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:20.500317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fc99f-d697-4a0a-8931-c36bbaa45234 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:20.513902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 558/1121] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:08:20 2022] PUT /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41/users/240c44919463409e9baf8bc46d21c0d0/roles/6d733f44594041f5bbc6de2766346027 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:08:22.763822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceee74-0ec8-4c8a-af00-40289d37eecf None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.764336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceee74-0ec8-4c8a-af00-40289d37eecf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.764446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceee74-0ec8-4c8a-af00-40289d37eecf None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.767297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 564/1122] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:22.772545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.772990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.773130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.791693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:22.792880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:22.848196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 559/1123] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:22.872006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceee74-0ec8-4c8a-af00-40289d37eecf None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:22.884699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceee74-0ec8-4c8a-af00-40289d37eecf None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:22.889027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:22.889848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.890815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.891088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] PATH_INFO: `/v3/roles/6d733f44594041f5bbc6de2766346027` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.892675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] RBAC: Authorizing `identity:get_role(role_id=6d733f44594041f5bbc6de2766346027)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:22.894303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:22.895631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 565/1124] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:22 2022] GET /identity/v3/roles/6d733f44594041f5bbc6de2766346027 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:22.901377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:22.911312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4aae3-518d-4eea-b6cb-8173df40991f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:22.916032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:22.916877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.917189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.917458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] PATH_INFO: `/v3/users/240c44919463409e9baf8bc46d21c0d0` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.918654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] RBAC: Authorizing `identity:get_user(user_id=240c44919463409e9baf8bc46d21c0d0)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:22.920752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:22.922971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 560/1125] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:22 2022] GET /identity/v3/users/240c44919463409e9baf8bc46d21c0d0 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:22.928439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:22.938333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a81b9-dba6-4987-b7d1-cfa198346641 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:22.942770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:22.943389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.943670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.943946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.951623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:22.953998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:22.962743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 566/1126] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:22.969727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:22.979253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac994d4-fe9f-4b93-a6e5-b731ef49f37d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:22.984402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:22.985754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:22.986039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:22.986310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] PATH_INFO: `/v3/projects/d0d3319f117b44dfb6bd1651735fac41` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:22.987490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=d0d3319f117b44dfb6bd1651735fac41)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:22.989565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db206c2-3968-403b-9c0d-f9d9c61639b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:22.991206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 561/1127] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:22 2022] GET /identity/v3/projects/d0d3319f117b44dfb6bd1651735fac41 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:22.997191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:23.006714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85efe-d7a1-4af9-a5af-fc77d1e0eaee admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:23.011560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:23.012189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:23.012470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:23.012746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:23.013614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] RBAC: Adding query filter params (role.id=6d733f44594041f5bbc6de2766346027, scope.project.id=d0d3319f117b44dfb6bd1651735fac41, user.id=240c44919463409e9baf8bc46d21c0d0) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:23.013929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:23.016008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825c871-f1a0-47d8-9c1a-45951b6214b3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:23.021810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 567/1128] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:22 2022] GET /identity/v3/role_assignments?user.id=240c44919463409e9baf8bc46d21c0d0&scope.project.id=d0d3319f117b44dfb6bd1651735fac41&role.id=6d733f44594041f5bbc6de2766346027 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:25.274900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1091b4c-3477-4584-83a8-529f0c456f1e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:25.275456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1091b4c-3477-4584-83a8-529f0c456f1e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:25.275456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1091b4c-3477-4584-83a8-529f0c456f1e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:25.277237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 562/1129] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:25.283289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:25.283716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:25.283839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:25.301289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:25.302454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:25.309934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 568/1130] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:25 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:25.333523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1091b4c-3477-4584-83a8-529f0c456f1e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:25.346256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1091b4c-3477-4584-83a8-529f0c456f1e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:25.350588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:25.351361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:25.351645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:25.351920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:25.353150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:25.354819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab06a-6cc0-499c-b16d-3ab60f4a1e61 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:25.356373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 563/1131] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:25.362099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:25.370826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018bbf74-b633-4b1b-850b-508a76e6c415 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:25.375849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:25.376478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:25.376754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:25.377067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:25.377782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:25.379651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d66a64-0455-47e0-8244-6f59d9b68b4e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:25.405844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 569/1132] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:08:25 2022] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:27.664796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb4e4-4dfb-4cf4-9ac6-21fa87033ec6 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:27.665386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb4e4-4dfb-4cf4-9ac6-21fa87033ec6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:27.665386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdb4e4-4dfb-4cf4-9ac6-21fa87033ec6 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:27.667118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 564/1133] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:27.672364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:27.672764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:27.672950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:27.691072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:27.692245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:27.748419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 570/1134] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:27.773639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb4e4-4dfb-4cf4-9ac6-21fa87033ec6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:27.786360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffdb4e4-4dfb-4cf4-9ac6-21fa87033ec6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:27.790687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:27.791459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:27.791736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:27.792004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:27.793190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:27.794866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c658ee-ca6f-4898-8427-3ddcbcdaca4f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:27.797253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 565/1135] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:08:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:27.802780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:27.813033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fda04-6d8d-4abd-a52a-eead91e5b233 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:27.817594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:27.818244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:27.818529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:27.818802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:27.819526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:27.821484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b316c-6548-4061-9b58-7410cfb8ed13 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:27.841264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 571/1136] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:08:27 2022] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:30.098736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa1ec-d60a-4e1a-a7e0-41500228e4e2 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.099252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa1ec-d60a-4e1a-a7e0-41500228e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.099252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647aa1ec-d60a-4e1a-a7e0-41500228e4e2 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.101018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 566/1137] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:30.106396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163de61-6808-44da-b815-c836a540ae24 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.106798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163de61-6808-44da-b815-c836a540ae24 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.106949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163de61-6808-44da-b815-c836a540ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.125721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0163de61-6808-44da-b815-c836a540ae24 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:30.126888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0163de61-6808-44da-b815-c836a540ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:30.134683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 572/1138] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:30.158814 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa1ec-d60a-4e1a-a7e0-41500228e4e2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.170965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647aa1ec-d60a-4e1a-a7e0-41500228e4e2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.175501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.176285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.176570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.176844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.187595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:30.194557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:30.195724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 567/1139] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:30.201749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163de61-6808-44da-b815-c836a540ae24 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.211230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163de61-6808-44da-b815-c836a540ae24 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.215679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.216320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.216602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.216873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.217660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:30.217997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:30.219573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:30.227647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 573/1140] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:30.233345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.244010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ca29c-842e-4a9e-9d16-50f7ac0f7db7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.248566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.250095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.250376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.250654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] PATH_INFO: `/v3/users/cbc21a4e3db2482e81ddebed45803b03` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.263830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] RBAC: Authorizing `identity:get_user(user_id=cbc21a4e3db2482e81ddebed45803b03)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:30.266160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:30.267826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 568/1141] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/users/cbc21a4e3db2482e81ddebed45803b03 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:30.273629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.283344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5ae2e-3ec9-4e84-97c9-fd659859866f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.287843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.288475 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.288755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.289067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.297447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:30.299195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:30.307947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 574/1142] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:30.314427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.323842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92097df-052b-4efa-b002-b7151fe74356 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.328946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.329784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.330065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.330339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] PATH_INFO: `/v3/projects/feb657a78a3a47d1868b2bab9fc8a212` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.331502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] RBAC: Authorizing `identity:get_project(project_id=feb657a78a3a47d1868b2bab9fc8a212)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:30.333557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa031d-98b0-4a16-9a73-9b277ef5651b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:30.335211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 569/1143] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/projects/feb657a78a3a47d1868b2bab9fc8a212 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:30.341101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:30.350674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7007d0-aac2-40c2-9c29-e86d279e4870 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:30.355199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:30.355830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:30.356110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:30.356385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:30.357256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=feb657a78a3a47d1868b2bab9fc8a212, user.id=cbc21a4e3db2482e81ddebed45803b03) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:30.357566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:30.359436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53066-0252-4230-81e6-85730cc9c53b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:30.364769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 575/1144] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:30 2022] GET /identity/v3/role_assignments?user.id=cbc21a4e3db2482e81ddebed45803b03&scope.project.id=feb657a78a3a47d1868b2bab9fc8a212&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:32.570464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c13c2-d442-4bea-82ae-c7c75e2941e9 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.571000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c13c2-d442-4bea-82ae-c7c75e2941e9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.571000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c13c2-d442-4bea-82ae-c7c75e2941e9 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.572757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 570/1145] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:32.578717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.579148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.579256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.597110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:32.598281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:32.605889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 576/1146] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:32.629266 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c13c2-d442-4bea-82ae-c7c75e2941e9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:32.642063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c13c2-d442-4bea-82ae-c7c75e2941e9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:32.646393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:32.647171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.647451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.647751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.658648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:32.665525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:32.666712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 571/1147] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:32.673221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:32.682653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638ba0-c854-4141-ba90-375d5b7b8105 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:32.687404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:32.688061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.688345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.688623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.689431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:32.689736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:32.691331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:32.699783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 577/1148] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:32.706328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:32.716467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba924e0-3eff-4879-923b-afdc06225bce admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:32.722286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:32.723139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.723422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.723695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] PATH_INFO: `/v3/users/cbc21a4e3db2482e81ddebed45803b03` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.724887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] RBAC: Authorizing `identity:get_user(user_id=cbc21a4e3db2482e81ddebed45803b03)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:32.727037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:32.728614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 572/1149] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:32 2022] GET /identity/v3/users/cbc21a4e3db2482e81ddebed45803b03 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:32.734281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:32.743936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796b00a-833e-4917-aacc-29fec937e80f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:32.748570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:32.749585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.749843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.750118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] PATH_INFO: `/v3/projects/feb657a78a3a47d1868b2bab9fc8a212` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.751328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] RBAC: Authorizing `identity:get_project(project_id=feb657a78a3a47d1868b2bab9fc8a212)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:32.753442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a041f48e-2e8d-47a6-9ac2-62bb5bed4b9c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:32.755131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 578/1150] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:32 2022] GET /identity/v3/projects/feb657a78a3a47d1868b2bab9fc8a212 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:32.761407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:32.776496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf64c-4b1f-4ce9-95bb-d4ff662cd43b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:32.782254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:32.783134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:32.783413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:32.783685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] PATH_INFO: `/v3/projects/feb657a78a3a47d1868b2bab9fc8a212/users/cbc21a4e3db2482e81ddebed45803b03/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:32.785782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb657a78a3a47d1868b2bab9fc8a212, user_id=cbc21a4e3db2482e81ddebed45803b03, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:32.788492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1758b3-c2c9-481c-abc4-0d0e267d3717 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:32.803075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 573/1151] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:08:32 2022] PUT /identity/v3/projects/feb657a78a3a47d1868b2bab9fc8a212/users/cbc21a4e3db2482e81ddebed45803b03/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:08:35.040857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94464-f7e8-4dbb-baef-cd66575cd8a1 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.041540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94464-f7e8-4dbb-baef-cd66575cd8a1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.041540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a94464-f7e8-4dbb-baef-cd66575cd8a1 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.043110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 579/1152] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:35.049556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.049974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.050119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.067980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:35.069206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:35.125560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 574/1153] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:35.149417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94464-f7e8-4dbb-baef-cd66575cd8a1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.162328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a94464-f7e8-4dbb-baef-cd66575cd8a1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.166647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.167406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.167684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.167952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.178871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:35.185587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:35.187082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 580/1154] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:35.193033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.201949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847f100-cfb5-4825-839d-85a50dbdce91 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.206606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.207262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.207548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.207822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.208578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:35.208886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:35.210513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:35.219232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 575/1155] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:35.224828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.235719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf217a-a5c4-408e-81e3-9c7a9a9a2d69 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.240235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.241099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.241382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.241653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] PATH_INFO: `/v3/users/cbc21a4e3db2482e81ddebed45803b03` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.242854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] RBAC: Authorizing `identity:get_user(user_id=cbc21a4e3db2482e81ddebed45803b03)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:35.244977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:35.246530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 581/1156] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/users/cbc21a4e3db2482e81ddebed45803b03 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:35.252345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.262219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61626b-0e95-4eae-85b2-e24b535da151 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.266881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.267511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.267796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.268072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.275766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:35.277541 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:35.287024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 576/1157] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:35.292827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.303072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e5f4-09fb-424d-a5df-fe11934a2124 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.307532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.308355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.308632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.308924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] PATH_INFO: `/v3/projects/feb657a78a3a47d1868b2bab9fc8a212` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.310088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=feb657a78a3a47d1868b2bab9fc8a212)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:35.312215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ebd889-6f59-40aa-928a-68edddf830b7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:35.313883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 582/1158] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/projects/feb657a78a3a47d1868b2bab9fc8a212 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:35.319818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:35.328719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eda4e7-b8f0-481c-a3ae-582d69249273 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:35.333313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:35.333947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:35.334232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:35.334509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:35.335335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=feb657a78a3a47d1868b2bab9fc8a212, user.id=cbc21a4e3db2482e81ddebed45803b03) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:35.335644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:35.337511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41232f6-2194-437e-9c97-98ada2560c8f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:35.343780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 577/1159] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:35 2022] GET /identity/v3/role_assignments?user.id=cbc21a4e3db2482e81ddebed45803b03&scope.project.id=feb657a78a3a47d1868b2bab9fc8a212&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:37.593514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a45d-3f77-40e7-b5af-1314fdfad2a4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:37.594078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a45d-3f77-40e7-b5af-1314fdfad2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:37.594078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203a45d-3f77-40e7-b5af-1314fdfad2a4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:37.595843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 583/1160] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:37.601036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:37.601455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:37.601589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:37.621589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:37.622765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:37.630559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 578/1161] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:37.653356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203a45d-3f77-40e7-b5af-1314fdfad2a4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:37.665927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203a45d-3f77-40e7-b5af-1314fdfad2a4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:37.670294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:37.671495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:37.671772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:37.672050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:37.680182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:37.681973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:37.691031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 584/1162] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:37.696976 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:37.705742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506013f-74b5-4232-94d3-5181245e8aaa None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:37.710248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:37.711026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:37.711305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:37.711575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:37.718869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:37.720688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:37.735353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f277503d-8229-4678-9323-9b5ff8617864 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 15 04:08:37.736514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 579/1163] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:08:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:37.742528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:37.751795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1aa946-a41b-4462-9e1b-ad0f7b3f0f30 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:37.756471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:37.757158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:37.757442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:37.757717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:37.758453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:37.759003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:37.760599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb79a93-7fd2-4c31-85f2-eab0a9ba83ed admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:37.768650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 585/1164] 10.222.0.45 () {56 vars in 1136 bytes} [Tue Feb 15 04:08:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:39.975793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1c5-238d-4f41-a2d5-77cf647dcda7 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:39.976302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1c5-238d-4f41-a2d5-77cf647dcda7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:39.976302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2c1c5-238d-4f41-a2d5-77cf647dcda7 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:39.978155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 580/1165] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:39.983903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0baa-7ef2-4630-9b35-284838bdca69 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:39.984324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0baa-7ef2-4630-9b35-284838bdca69 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:39.984451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e0baa-7ef2-4630-9b35-284838bdca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:40.002337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-277e0baa-7ef2-4630-9b35-284838bdca69 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:40.003863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-277e0baa-7ef2-4630-9b35-284838bdca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:40.011680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 586/1166] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:40.035162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c1c5-238d-4f41-a2d5-77cf647dcda7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:40.048409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2c1c5-238d-4f41-a2d5-77cf647dcda7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:40.052743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:40.053527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:40.053847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:40.054152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:40.054911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:40.055933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:08:40.055933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:08:40.055933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:08:40.056801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861e499-3d36-4054-955e-eaf99a2e070f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:40.071888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 581/1167] 10.222.0.45 () {60 vars in 1159 bytes} [Tue Feb 15 04:08:40 2022] POST /identity/v3/domains => generated 267 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:42.341509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df756b-fb38-4fbc-8995-790b1dcad0d0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:42.342049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df756b-fb38-4fbc-8995-790b1dcad0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:42.342049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df756b-fb38-4fbc-8995-790b1dcad0d0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:42.344536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 587/1168] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:42.349844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:42.350290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:42.350471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:42.368527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:42.369806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:42.425964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 582/1169] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:42.450281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df756b-fb38-4fbc-8995-790b1dcad0d0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:42.462498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df756b-fb38-4fbc-8995-790b1dcad0d0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:42.466797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:42.467768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:42.468175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:42.468455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] PATH_INFO: `/v3/domains/1eaff3a4ce0543c7b5a09ecc43e37c6e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:42.478963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1eaff3a4ce0543c7b5a09ecc43e37c6e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:42.480959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f07092-3bdc-4854-8600-89d3d27fda8d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:42.482595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 588/1170] 10.222.0.45 () {56 vars in 1204 bytes} [Tue Feb 15 04:08:42 2022] GET /identity/v3/domains/1eaff3a4ce0543c7b5a09ecc43e37c6e => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:42.488990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:42.497819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8871a-4277-49e6-a73a-3d3461807c47 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:42.502964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:42.503661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:42.503980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:42.504291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:42.505061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:42.506987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ce283-6b8c-42bd-a912-24fb61b683be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:42.532209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 583/1171] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:08:42 2022] POST /identity/v3/projects => generated 361 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:08:44.795887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9512f-c87a-4b9a-a137-3bd8d25717f5 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:44.796524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9512f-c87a-4b9a-a137-3bd8d25717f5 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:44.796524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc9512f-c87a-4b9a-a137-3bd8d25717f5 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:44.798241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 589/1172] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:44.803691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714534d-03fe-49af-8744-f2611ad480db None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:44.804091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714534d-03fe-49af-8744-f2611ad480db None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:44.804301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714534d-03fe-49af-8744-f2611ad480db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:44.823882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9714534d-03fe-49af-8744-f2611ad480db None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:44.825107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9714534d-03fe-49af-8744-f2611ad480db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:44.882670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 584/1173] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:44.908757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9512f-c87a-4b9a-a137-3bd8d25717f5 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:44.921284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc9512f-c87a-4b9a-a137-3bd8d25717f5 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:44.925800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:44.926628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:44.926907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:44.927178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] PATH_INFO: `/v3/domains/1eaff3a4ce0543c7b5a09ecc43e37c6e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:44.928345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=1eaff3a4ce0543c7b5a09ecc43e37c6e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:44.930320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36104652-18de-47c3-9f6d-26fe58a95259 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:44.931877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 590/1174] 10.222.0.45 () {56 vars in 1204 bytes} [Tue Feb 15 04:08:44 2022] GET /identity/v3/domains/1eaff3a4ce0543c7b5a09ecc43e37c6e => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:44.937825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714534d-03fe-49af-8744-f2611ad480db None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:44.946707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714534d-03fe-49af-8744-f2611ad480db None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:44.951229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:44.952166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:44.952499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:44.952815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:44.953588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:44.955561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6d01a-0455-4a34-a408-50123aa0bf32 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:44.975567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 585/1175] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:08:44 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:08:47.234305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9e0a-d24c-40e5-9d87-f9a5b02c02c8 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.234908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9e0a-d24c-40e5-9d87-f9a5b02c02c8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.234908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d9e0a-d24c-40e5-9d87-f9a5b02c02c8 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.236652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 591/1176] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:47.241999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.242407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.242624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.260684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:47.261906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:47.270093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 586/1177] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:47.293530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9e0a-d24c-40e5-9d87-f9a5b02c02c8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.306004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d9e0a-d24c-40e5-9d87-f9a5b02c02c8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.310357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.311629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.311944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.312263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.322724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:47.330346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:47.331509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 592/1178] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:08:47.337532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.346570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1397918-4669-48e6-b456-f5895bd44abd None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.351103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.351807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.352125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.352435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.353263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:47.353592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:47.355194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:47.363652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 587/1179] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:47.369552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.379687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd5641-4df7-49c8-8d2d-3101e2b87174 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.384486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.385369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.385652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.385925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] PATH_INFO: `/v3/users/21099e3227854916853d4ad604511764` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.399810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] RBAC: Authorizing `identity:get_user(user_id=21099e3227854916853d4ad604511764)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:47.401982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:47.403612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 593/1180] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/users/21099e3227854916853d4ad604511764 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:47.409317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.418802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d31b80-4c52-4146-9a28-738fc6498005 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.423367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.424046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.424365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.424669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.432301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:47.434094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:47.443491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 588/1181] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:47.449161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.459523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03922fe-1838-4b94-9050-8c19b86b0346 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.463964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.464794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.465104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.465378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] PATH_INFO: `/v3/projects/6eaf051cac654d54a5e170e6cabb9a28` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.466533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] RBAC: Authorizing `identity:get_project(project_id=6eaf051cac654d54a5e170e6cabb9a28)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:47.469218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b174978-a04f-4d2a-8932-8a1331e4f822 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:47.470856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 594/1182] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/projects/6eaf051cac654d54a5e170e6cabb9a28 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:08:47.476908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:47.486546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0193b3-585d-4b31-847a-5429a405d78c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:47.491080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:47.491764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:47.492083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:47.492367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:47.493235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=6eaf051cac654d54a5e170e6cabb9a28, user.id=21099e3227854916853d4ad604511764) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:47.493572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:47.495412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dfbb01-9bf6-47fa-9382-1a30c6df752d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:47.501095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 589/1183] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:47 2022] GET /identity/v3/role_assignments?user.id=21099e3227854916853d4ad604511764&scope.project.id=6eaf051cac654d54a5e170e6cabb9a28&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:49.712948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e010-ac6c-4811-974a-ee4cef20e046 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.713509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e010-ac6c-4811-974a-ee4cef20e046 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.713509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0e010-ac6c-4811-974a-ee4cef20e046 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.715258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 595/1184] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:49.721433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.721905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.722056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.740065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:49.741275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:49.748932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 590/1185] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:08:49.773199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e010-ac6c-4811-974a-ee4cef20e046 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:49.786162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0e010-ac6c-4811-974a-ee4cef20e046 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:49.790553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:49.791321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.791605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.791883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.802447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:49.809173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:49.810356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 596/1186] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:49.816634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:49.825542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb46c7-0743-43f0-a32c-56cf05358806 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:49.830725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:49.831428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.831752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.832065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.832858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:49.833220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:49.834820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:49.843580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 591/1187] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:49.849354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:49.860491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7804-183f-42b6-a325-f116bf16afad admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:49.865041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:49.865876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.866157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.866431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] PATH_INFO: `/v3/users/21099e3227854916853d4ad604511764` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.867618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] RBAC: Authorizing `identity:get_user(user_id=21099e3227854916853d4ad604511764)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:49.869797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:49.871399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 597/1188] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:49 2022] GET /identity/v3/users/21099e3227854916853d4ad604511764 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:49.877175 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:49.886872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26e855-eb56-4e11-b28d-642ff81b6b28 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:49.892045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:49.892954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.893272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.893555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] PATH_INFO: `/v3/projects/6eaf051cac654d54a5e170e6cabb9a28` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.894726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] RBAC: Authorizing `identity:get_project(project_id=6eaf051cac654d54a5e170e6cabb9a28)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:49.896754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b695da2-555f-40da-9b00-5e67ae39fbbf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:49.898462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 592/1189] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:49 2022] GET /identity/v3/projects/6eaf051cac654d54a5e170e6cabb9a28 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:49.904079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:49.914381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0b4a1-275e-444a-8c8b-f2b359ae4e66 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:49.918874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:49.919738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:49.920017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:49.920425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] PATH_INFO: `/v3/projects/6eaf051cac654d54a5e170e6cabb9a28/users/21099e3227854916853d4ad604511764/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:49.922536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eaf051cac654d54a5e170e6cabb9a28, user_id=21099e3227854916853d4ad604511764, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:49.925189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1f04-d039-4fa5-9914-50e1dd8392ef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:49.937934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 598/1190] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:08:49 2022] PUT /identity/v3/projects/6eaf051cac654d54a5e170e6cabb9a28/users/21099e3227854916853d4ad604511764/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:08:52.156984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234693-a253-4095-8837-456887d0e3b7 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.157496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234693-a253-4095-8837-456887d0e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.157496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234693-a253-4095-8837-456887d0e3b7 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.159331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 593/1191] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:08:52.164790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.165211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.165366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.301290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:08:52.302492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:08:52.358776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 599/1192] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:08:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:08:52.382609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234693-a253-4095-8837-456887d0e3b7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.394924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234693-a253-4095-8837-456887d0e3b7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.399295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.400112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.400433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.400742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.411445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:08:52.418295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:08:52.419470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 594/1193] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:08:52.426208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.435056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb6622-41f1-4762-93de-2ec217291b46 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.439597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.440244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.440522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.440794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.441588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:52.441892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:52.443481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:52.452011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 600/1194] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:52.457711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.468434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408ca6a-fef5-447a-b5b1-be7b57c82151 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.472975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.473871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.474191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.474478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] PATH_INFO: `/v3/users/21099e3227854916853d4ad604511764` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.475671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] RBAC: Authorizing `identity:get_user(user_id=21099e3227854916853d4ad604511764)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:52.477836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:52.479474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 595/1195] 10.222.0.45 () {56 vars in 1198 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/users/21099e3227854916853d4ad604511764 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:52.486192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.495740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899eed6-c1cb-4151-8fad-3ae4746c767c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.500290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.500943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.501228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.501501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.509497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:52.511230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:52.519916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 601/1196] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:08:52.525846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.537322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432480af-9b8b-43f9-838b-f1f4786ce909 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.541792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.542679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.542994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.543279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] PATH_INFO: `/v3/projects/6eaf051cac654d54a5e170e6cabb9a28` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.544445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] RBAC: Authorizing `identity:get_project(project_id=6eaf051cac654d54a5e170e6cabb9a28)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:52.547701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5de05-ad65-49c9-976e-3e8e3cb7676f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:52.549417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 596/1197] 10.222.0.45 () {56 vars in 1207 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/projects/6eaf051cac654d54a5e170e6cabb9a28 => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:08:52.555511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:08:52.564350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b49178-697e-480c-b932-eb547e01c4f0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:08:52.568917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:08:52.569561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:08:52.569840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:08:52.570113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:08:52.570938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=6eaf051cac654d54a5e170e6cabb9a28, user.id=21099e3227854916853d4ad604511764) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:08:52.571243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:08:52.573095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e6621-9d06-4653-a193-9af79036c5b2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:08:52.579126 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 602/1198] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:08:52 2022] GET /identity/v3/role_assignments?user.id=21099e3227854916853d4ad604511764&scope.project.id=6eaf051cac654d54a5e170e6cabb9a28&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:09:56.302815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096a703-9973-41f3-b1c4-d03f6bd482d1 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:56.302815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096a703-9973-41f3-b1c4-d03f6bd482d1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:56.302815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096a703-9973-41f3-b1c4-d03f6bd482d1 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:56.304092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 597/1199] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:09:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:09:56.313269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:56.314600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:56.315546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:56.345951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:09:56.347868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:09:56.372954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 603/1200] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:09:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:09:56.401701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096a703-9973-41f3-b1c4-d03f6bd482d1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:56.424490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096a703-9973-41f3-b1c4-d03f6bd482d1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:56.429975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:56.430930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:56.431245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:56.431565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:56.446465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:56.449203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:56.487886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:09:56.496771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 598/1201] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:09:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:09:56.498531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:56.510759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c022a-1635-427f-9170-b3142fdf2157 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:56.518115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:56.518863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:56.519144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:56.519452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:56.520299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:09:56.520641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:56.526093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4aadd6-50b0-4b25-8a8f-7aef6fac60e3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:56.549069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 604/1202] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:09:56.554772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:56.572881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7272215-e5e3-4bda-814a-fd03c6ffe538 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:56.581119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:56.582423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:56.583140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:56.583727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:56.585158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:56.589062 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b95854c-f171-4256-9332-2987d7c3394c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:56.627044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 599/1203] 10.222.0.45 () {60 vars in 1153 bytes} [Tue Feb 15 04:09:56 2022] POST /identity/v3/users => generated 251 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:09:59.653420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dd68-683b-49d4-a393-0435d8ca411f None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.653420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dd68-683b-49d4-a393-0435d8ca411f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.653420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676dd68-683b-49d4-a393-0435d8ca411f None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.654822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 605/1204] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:09:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:09:59.664102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.664669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.665180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.695743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:09:59.698290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:09:59.712355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 600/1205] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:09:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:09:59.757018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676dd68-683b-49d4-a393-0435d8ca411f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:59.780863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676dd68-683b-49d4-a393-0435d8ca411f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:59.782653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:59.783470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.783914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.784399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.805777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:09:59.816031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:09:59.819946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 606/1206] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:09:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:09:59.823647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:59.835524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554b38-1649-46b6-b120-cba9dbf211b6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:59.841617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:59.842297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.842580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.842856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.843629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:09:59.843936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:59.845721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:59.859546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 601/1207] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:09:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:09:59.866838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:59.889474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2d27f-118a-47a6-9708-087595fd505a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:59.897900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:59.899321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.899859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.900373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.920168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:59.922412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:59.947168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:09:59.948464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 607/1208] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:09:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:09:59.955494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:09:59.968217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0cf6d-b8b6-49f7-b0b9-f9a144af41a0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:09:59.974323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:09:59.975342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:09:59.975807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:09:59.976164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:09:59.978536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:09:59.979325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:09:59.981653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:09:59.999062 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 602/1209] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:00.005428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.017505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8a15-69b2-41ba-8c2d-9cfad54cce99 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.022723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.023535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.023804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.024074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.035215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.037901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.055612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:00.057603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 608/1210] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:00.065792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.078829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de8684-5d6d-495a-a2e3-27de9d782cd9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.084582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.085460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.085750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.086033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.086970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:00.087301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.090499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.114556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 603/1211] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:00.122391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.138936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a474d-1deb-482f-a60b-f5f6e7b63ea4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.143824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.144620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.145210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.145643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.157802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.160301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.177591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 609/1212] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:10:00.188777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.200210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dedc2-cdc2-46bb-8f3e-db0af2550f14 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.207668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.208686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.209123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.209496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.226581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.232323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.255107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:00.258642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 604/1213] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:00.266854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.279627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7fac1-d74c-4bc0-9978-5c988ebe3d04 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.285545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.286376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.286614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.286894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.287745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:00.288075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.289870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.306676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 610/1214] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:00.312979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.326671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa980ca-97d6-483f-9ecb-9aea842c742c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.332554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.333602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.333982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.334353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.344189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.347176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.364004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:00.365870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 605/1215] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:00.372362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.384466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc107c1f-e8bf-45f2-b6c9-ac2e66abcac3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.395779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.396568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.396809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.397156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.398037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:00.398394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.400356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab7158-b638-4d8e-b131-63d131e79c84 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.417540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 611/1216] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:00.425509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:00.441252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7504-e268-422e-a7aa-ee4e6fb57a1f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:00.451492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:00.452499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:00.452936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:00.453364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:00.454989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=c8282bf8c7464ea5a8a84e84b3534ccc) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:00.455490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:00.457899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a062c6-ea3c-41a0-a155-511af0132c9f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:00.470660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 606/1217] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:10:00 2022] GET /identity/v3/role_assignments?user.id=c8282bf8c7464ea5a8a84e84b3534ccc&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.083515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5407-680d-4742-8605-2fa95355eb60 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.084305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5407-680d-4742-8605-2fa95355eb60 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.084305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb5407-680d-4742-8605-2fa95355eb60 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.086043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 612/1218] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:10:03.092342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.093141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.093141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.113609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:03.114937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:03.125914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 607/1219] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:10:03.153171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb5407-680d-4742-8605-2fa95355eb60 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.167502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb5407-680d-4742-8605-2fa95355eb60 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.175708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.177070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.177559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.178017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.197873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:10:03.208950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:10:03.210730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 613/1220] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:03.220998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.238515 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ab3c-d584-498d-a891-003be4f63e44 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.248456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.249665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.250155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.250639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.252042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:03.252580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.256177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.273674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 608/1221] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.283274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.299949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fd05e-6a7c-414e-bf88-39cd0b709dff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.306068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.307119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.307400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.307686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.329847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.333165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.363818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:03.372506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 614/1222] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:03.374995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.396030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284f877-8db3-4178-ba31-d8f5843b569e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.406789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.408016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.408507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.409033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.410382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:03.410904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.413977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.443101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 609/1223] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.446249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.459448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25998657-8758-4559-9e4c-66591c13bb3c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.470665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.470665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.470665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.470665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.485083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.489254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.518392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:03.525134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 615/1224] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:03.526457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.544787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e035f4-81d1-4a78-ab1e-866930c934f7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.553549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.554688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.555187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.555664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.557385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:03.557925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.561756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.596503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 610/1225] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.604664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.620793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53b55f-40e8-4cc2-93d0-dd145b5ba7ef admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.626875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.627675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.627956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.628225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.639773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.641684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.671978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:03.673382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 616/1226] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:03.679890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.703491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57025d9b-c8b5-468b-a604-47916870614e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.710922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.711781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.712200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.712541 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.713524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:03.713916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.716625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.736941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 611/1227] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.744589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.761055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbe208-ef0f-4086-ae31-0763258cf28c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.769290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.770840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.771323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.771803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.786355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.790481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.817221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:03.819792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 617/1228] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:03.829949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.847005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5501-86db-47ae-a5c6-73583d32a8b8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.856349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.857593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.858069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.858551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.860080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:03.860649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.864398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999e94c-e739-4003-9e4f-6eed565e6c82 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.886138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 612/1229] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:03.896313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:03.914102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f9366-2b03-46db-8c9c-ca63c353c90e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:03.921862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:03.923707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:03.924612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:03.925515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/c8282bf8c7464ea5a8a84e84b3534ccc/roles/7ef532c6133a4056b49eb8cbf08d1441` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:03.951105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=c8282bf8c7464ea5a8a84e84b3534ccc, role_id=7ef532c6133a4056b49eb8cbf08d1441)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:03.954353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a794-2dc2-42a0-96be-71f91bcb3d0a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:03.975776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 618/1230] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:10:03 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/c8282bf8c7464ea5a8a84e84b3534ccc/roles/7ef532c6133a4056b49eb8cbf08d1441 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:10:06.369668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d239a3-8c24-492b-81ea-a67f79103ac5 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.370257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d239a3-8c24-492b-81ea-a67f79103ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.370396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d239a3-8c24-492b-81ea-a67f79103ac5 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.374313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 613/1231] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:06.380270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.380870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.381825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.409841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:06.411344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:06.491078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 619/1232] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:06.521848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d239a3-8c24-492b-81ea-a67f79103ac5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.537078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d239a3-8c24-492b-81ea-a67f79103ac5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.543404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.544530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.544875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.545219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.559081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:10:06.568637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 15 04:10:06.569943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 614/1233] 10.222.0.45 () {56 vars in 1123 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:06.576678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.588285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4040f-f22c-49fc-a2b0-706e5963eb12 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.593462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.594298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.594714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.595016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.595872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:06.596210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.598191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.608950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 620/1234] 10.222.0.45 () {56 vars in 1124 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:06.614612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.627934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b84e4-3692-4ede-a1a2-3c6633c13eac admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.634135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.635047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.635448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.635692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.651572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.655302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.682355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:06.684096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 615/1235] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:06.690192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.701429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522c383-2457-4830-8230-b6084a79dd65 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.706823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.707555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.707921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.708184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.709072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:06.709401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.711246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.727200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 621/1236] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:06.734584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.746680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe864a5-f41d-4dc1-8b69-ce44a8531f32 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.752068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.753466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.753466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.753466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.762742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.765113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.782578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:06.783941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 616/1237] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:06.791577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.804734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7addb4-a6e4-4bf9-b5aa-7b9af66eb86b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.811794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.812559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.812941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.813288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.814219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:06.814592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.816558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.839095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 622/1238] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:06.845841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.859330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa3d7c-6b47-4d79-9a7d-408cbb7986a0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.865379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.866333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.866969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.867531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.879342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.881402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.893338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 617/1239] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:10:06.899478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.912765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccb71d-62a6-4dff-8c31-df48a5da9aea admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.919813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.920975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.921262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.921531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.935277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.937695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:06.960581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:06.961954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 623/1240] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:06.968999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:06.978488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff567c1-8267-4eee-9c2b-ec451efe096b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:06.985313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:06.986159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:06.986445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:06.986746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:06.987664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:06.988020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:06.989999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:07.008983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 618/1241] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:07.020082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:07.031247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b423ed2-9d37-4a5b-8231-e8be1c542d3b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:07.036370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:07.037198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:07.037482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:07.037787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:07.046008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:07.047994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:07.063934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:07.065375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 624/1242] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:07.074491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:07.090880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ad741-2fcc-45ae-a8f7-aed6475125d7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:07.100416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:07.101584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:07.102070 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:07.102558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:07.104093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:07.104638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:07.109830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d3dd9-d819-4c82-ad72-444117f3262a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:07.133677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 619/1243] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:07.141512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:07.163073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13228146-d029-4d08-9679-c2af5c032acc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:07.171273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:07.171936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:07.172264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:07.172513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:07.173342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] RBAC: Adding query filter params (role.id=7ef532c6133a4056b49eb8cbf08d1441, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=c8282bf8c7464ea5a8a84e84b3534ccc) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:07.173642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:07.175485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a768643-0687-4c83-ac4a-dfd1224356e6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:07.182010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 625/1244] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:10:07 2022] GET /identity/v3/role_assignments?user.id=c8282bf8c7464ea5a8a84e84b3534ccc&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=7ef532c6133a4056b49eb8cbf08d1441 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:09.703273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9bf0-883a-4a15-bc3f-0008a7e48b09 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.703847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9bf0-883a-4a15-bc3f-0008a7e48b09 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.705162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b9bf0-883a-4a15-bc3f-0008a7e48b09 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.708793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 620/1245] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:09.713393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.713907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.713998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.734135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:09.735330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:09.745898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 626/1246] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:09.773595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9bf0-883a-4a15-bc3f-0008a7e48b09 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:09.791067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b9bf0-883a-4a15-bc3f-0008a7e48b09 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:09.798135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:09.799347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.799753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.800208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.815980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:10:09.823504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:10:09.824779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 621/1247] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:10:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:09.830833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:09.841908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc6528-722e-4c74-be48-edb67b861379 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:09.846732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:09.847390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.847669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.847944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.848707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:09.849043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:09.850654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:09.860320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 627/1248] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:10:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:09.867012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:09.879149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eff97-5b2b-484c-8f06-98388337899a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:09.884670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:09.885571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.885860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.886692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.902589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:09.904669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:09.926426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:09.927690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 622/1249] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:09.934632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:09.945144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052286-06bd-45d4-b066-6e7bd74a50d9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:09.950678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:09.951339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.951619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.951894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:09.952634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:09.952973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:09.954706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:09.969233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 628/1250] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:09.975929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:09.988652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304a938-0a44-402c-9742-d7e60c9fb5b8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:09.994185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:09.995086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:09.995471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:09.996356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.007653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.010337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.032866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:10.034714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 623/1251] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:10.041702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.055060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10dc6f-9297-4e0e-9eb2-979928b4579d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.061510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.062299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.062662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.063024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.064074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:10.064498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.066529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.088321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 629/1252] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:10.094828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.105587 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff519c6d-91f6-49e9-b17e-d5be041e93f0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.110492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.111195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.111477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.111773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.121054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.122914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.133176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 624/1253] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:10:10.139505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.152876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fd7d5-5de1-482b-b88c-caa02cd9a6ff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.158553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.159466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.159814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.160163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.173147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.175183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.200862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:10.202705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 630/1254] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:10.210552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.223040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270cbad-b07e-4864-be96-2d7803d35631 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.228989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.230421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.230793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.231231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.232076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:10.232486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.234354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.247800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 625/1255] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:10.254029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.267919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c72fa0-1602-4a54-a806-dddc35d818ad admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.275142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.276079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.276362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.276691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.287128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.289949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.307130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:10.309398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 631/1256] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:10.318116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.334979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476229e-1ffd-4007-9eb5-6d7abdbd427e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.344685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.345619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.345956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.346290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.347679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:10.348210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.351006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e07142-4ea6-4deb-b694-95aec0d20c01 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.367676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 626/1257] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:10.374679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:10.386948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055ba7a-8d8c-44d8-abc3-f23739206443 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:10.392769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:10.393582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:10.393964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:10.394478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:10.395538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=c8282bf8c7464ea5a8a84e84b3534ccc) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:10.395927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:10.397908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f5a14-cdab-43cc-8b4c-525d19834dd7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:10.407612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 632/1258] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:10:10 2022] GET /identity/v3/role_assignments?user.id=c8282bf8c7464ea5a8a84e84b3534ccc&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:12.912010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8511-f323-4832-a979-fff2eaac0a75 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:12.912803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8511-f323-4832-a979-fff2eaac0a75 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:12.912803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db8511-f323-4832-a979-fff2eaac0a75 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:12.915194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 627/1259] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:12.923160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:12.923733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:12.923733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:12.946873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:12.948261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:12.959186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 633/1260] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:12.987408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db8511-f323-4832-a979-fff2eaac0a75 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.002094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db8511-f323-4832-a979-fff2eaac0a75 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.009485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421837b-c578-436b-9956-79374580390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.010745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421837b-c578-436b-9956-79374580390c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.012116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421837b-c578-436b-9956-79374580390c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.012626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421837b-c578-436b-9956-79374580390c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.033387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421837b-c578-436b-9956-79374580390c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:10:13.041239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-4421837b-c578-436b-9956-79374580390c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:10:13.043129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 628/1261] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:10:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:13.052147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.062486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c06a6-9f5c-4bf3-b367-acce2e39c4e4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.067569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.068231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.068513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.068864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.069791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:13.070001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.071633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.088791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 634/1262] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:13.095827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421837b-c578-436b-9956-79374580390c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.107684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421837b-c578-436b-9956-79374580390c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.113583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.121563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.122096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.122432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.138397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.140421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.160022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:13.161313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 629/1263] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:13.167770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.178192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bca02-cf23-483b-b980-c009c82b1a4b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.183610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.184357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.184635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.184968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.185705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:13.186012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.187768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.207341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 635/1264] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:13.208604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.218825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63463e-7e60-4cae-b0e8-0c381d61324e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.224119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.224947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.225239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.225494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.235160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.237027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.255173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:13.257037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 630/1265] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:13.264735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.276220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36676a-03f5-4043-93bc-88145f2d6fcf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.282569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.283362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.283646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.283961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.284858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:13.285228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.287510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.314469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 636/1266] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:13.321926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.334518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26173e1-caf2-42c6-a467-9d211e955939 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.340630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.341491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.341765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.342032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.356870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.359890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.387849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:13.390129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 631/1267] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:13.399097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.416465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5593cf-ac42-42be-919d-4a73e5d2f1d7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.423009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.423746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.424079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.431610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.433001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:13.433509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.435336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.447778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 637/1268] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:13.454081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.467748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b02a74-c3aa-404a-acf4-4206be629d3b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.473878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.474838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.475177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.475538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.485205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.487604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.502997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:13.504250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 632/1269] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:13.510694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.521577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70efe1-cbb1-465b-a5ca-0066cce67537 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.528184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.529381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.529886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.530320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.531574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:13.532165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.535335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7b418-585e-4f8f-93b4-fec01b435df2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.553599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 638/1270] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:13.561605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:13.572249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbd525-2c8f-43ca-914e-4436d9812075 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:13.577523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:13.578527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:13.578837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:13.579211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] PATH_INFO: `/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/c8282bf8c7464ea5a8a84e84b3534ccc/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:13.583184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76b6b9b9e8247fbb69f16bb93c42b53, user_id=c8282bf8c7464ea5a8a84e84b3534ccc, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:13.588076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595005e-39c9-4fc2-884c-5f6915ebe8f5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:13.612674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 633/1271] 10.222.0.45 () {58 vars in 1460 bytes} [Tue Feb 15 04:10:13 2022] PUT /identity/v3/projects/e76b6b9b9e8247fbb69f16bb93c42b53/users/c8282bf8c7464ea5a8a84e84b3534ccc/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:10:16.068831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7800-4c54-4d61-bfc5-0357932eda93 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.069634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7800-4c54-4d61-bfc5-0357932eda93 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.069634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7800-4c54-4d61-bfc5-0357932eda93 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.071931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 639/1272] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:16.080705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.081293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.081673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.106473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:16.107886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:16.180552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 634/1273] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:16.214595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7800-4c54-4d61-bfc5-0357932eda93 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.232032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7800-4c54-4d61-bfc5-0357932eda93 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.237491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.238368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.238652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.238920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.253849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 15 04:10:16.264528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 15 04:10:16.266044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 640/1274] 10.222.0.45 () {56 vars in 1117 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:16.274237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.290281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efdc2f-bf6a-40c7-a125-6c92b2ade5d5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.298135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.299341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.299973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.300494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.302023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.302539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.304813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.317462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 635/1275] 10.222.0.45 () {56 vars in 1120 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:16.324325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.335511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd645e-092c-47f6-a74c-7f1319ea54fc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.345457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.346258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.346534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.346836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.359157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.361182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.379345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:16.381051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 641/1276] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:16.388938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.400092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df5f45-6b52-4897-9c38-f58abfb90517 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.406215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.406964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.407394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.407746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.409202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.409694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.411791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.428222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 636/1277] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:16.434655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.445209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c27b7-5228-479f-90ca-9678a4bbf8e5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.451606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.452449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.452727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.453036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.462155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.464973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.481215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 15 04:10:16.482483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 642/1278] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:16.490800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.502180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fac9a0-b24c-441c-8be4-697709479d62 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.510191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.511252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.511539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.511851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.512781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.513129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.515018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.536764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 637/1279] 10.222.0.45 () {56 vars in 1164 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:16.547031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.559781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822eabb-cea3-4f42-9db5-e1b39f246941 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.568571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.569907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.570474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.571094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.585650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.589570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.608946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 643/1280] 10.222.0.45 () {58 vars in 1324 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:10:16.612585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.624491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c222f49-c35f-4740-9ac4-ea5c22664c05 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.631325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.632539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.632873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.633208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.652374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.655204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.680906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 15 04:10:16.682483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 638/1281] 10.222.0.45 () {56 vars in 1129 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 15 04:10:16.690096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.703241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454ba7a-aca5-4fa1-9c14-c5b5fffbf40a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.710230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.710970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.711332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.711653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.712531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.712917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.715019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.735477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 644/1282] 10.222.0.45 () {56 vars in 1130 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:10:16.742200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.755922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3365580-6a9f-4644-b20f-3885049f06e3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.762632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.763405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.763743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.764031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.772029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.774183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.789688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING keystone.server.flask.application [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 15 04:10:16.791453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 639/1283] 10.222.0.45 () {56 vars in 1132 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:16.798137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.808487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b40cc2-b5ab-4e74-8d15-caba22d4ba50 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.813435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.814132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.814362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.814719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.815439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.815746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.818830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d627c-00f8-4ef6-b691-ec653d782044 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.835973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 645/1284] 10.222.0.45 () {56 vars in 1169 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:16.843421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:16.859637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ef33-d93e-415e-a46b-2d48029021aa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:16.871363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:16.872071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:16.872436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:16.872705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:16.873674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] RBAC: Adding query filter params (role.id=3e51986d5b3b4564805a85330713b776, scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53, user.id=c8282bf8c7464ea5a8a84e84b3534ccc) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:16.873987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:16.876009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6b1b6-bcc5-49e1-88a2-6b74e2822103 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:16.884097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 640/1285] 10.222.0.45 () {56 vars in 1395 bytes} [Tue Feb 15 04:10:16 2022] GET /identity/v3/role_assignments?user.id=c8282bf8c7464ea5a8a84e84b3534ccc&scope.project.id=e76b6b9b9e8247fbb69f16bb93c42b53&role.id=3e51986d5b3b4564805a85330713b776 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:19.509039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e158-2413-47c7-a7fe-44520a8a39e8 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:19.509731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e158-2413-47c7-a7fe-44520a8a39e8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:19.509731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8e158-2413-47c7-a7fe-44520a8a39e8 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:19.511430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 646/1286] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:19.517380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:19.517921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:19.517921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:19.536861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:19.538115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:19.546869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 641/1287] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:19.569332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e158-2413-47c7-a7fe-44520a8a39e8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:19.582823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8e158-2413-47c7-a7fe-44520a8a39e8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:19.587299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:19.588093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:19.588372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:19.588666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:19.590099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:19.591684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:19.602977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 15 04:10:19.604154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 647/1288] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:10:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:19.611000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:19.620003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4be42-3b2e-40e9-89e2-c5543487f4fe None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:19.625036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:19.625817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:19.626197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:19.626560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:19.627350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:19.627755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:19.629591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc80fe-2292-4dd5-b401-f70195287362 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:19.635717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 642/1289] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Feb 15 04:10:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:19.642171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:19.655906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f227fa8-6aad-4f84-bacc-9e5773bd71ca admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:19.664786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:19.666014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:19.666535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:19.667666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] PATH_INFO: `/v3/services` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:19.668932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:19.669487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:19.672550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375611e8-ce04-47ff-bd9e-3b4bfca09da0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:19.678084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 648/1290] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Feb 15 04:10:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:21.928941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac20a3-42a0-449f-8a55-3d496a96b776 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:21.929498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac20a3-42a0-449f-8a55-3d496a96b776 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:21.929498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac20a3-42a0-449f-8a55-3d496a96b776 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:21.931595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 643/1291] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:21.936860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3da95-5a19-4ebb-9627-64a374c862e0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:21.937330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3da95-5a19-4ebb-9627-64a374c862e0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:21.937425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3da95-5a19-4ebb-9627-64a374c862e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:21.955599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-2bb3da95-5a19-4ebb-9627-64a374c862e0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:21.956777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2bb3da95-5a19-4ebb-9627-64a374c862e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:21.965252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 649/1292] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:21.988564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac20a3-42a0-449f-8a55-3d496a96b776 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:22.000666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac20a3-42a0-449f-8a55-3d496a96b776 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:22.005118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:22.005765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:22.006050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:22.006331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:22.007324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:22.008939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a5bdc-1350-4521-acc9-615fd464835a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:22.024192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 644/1293] 10.222.0.45 () {60 vars in 1162 bytes} [Tue Feb 15 04:10:21 2022] POST /identity/v3/services => generated 246 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:10:24.307277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5631a-e152-4063-8af9-335f02f5eed4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.307848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5631a-e152-4063-8af9-335f02f5eed4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.308634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5631a-e152-4063-8af9-335f02f5eed4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.310450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 650/1294] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:24.315665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.316091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.316224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.334030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:24.335210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:24.352884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 645/1295] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:24 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:24.376911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5631a-e152-4063-8af9-335f02f5eed4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:24.389423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5631a-e152-4063-8af9-335f02f5eed4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:24.393725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:24.394489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.394764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.395034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.395690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:24.397315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:24.408355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 15 04:10:24.409510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 651/1296] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:10:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:24.415558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:24.424965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846aeff-a523-4482-add1-42c3b618b194 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:24.429453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:24.430096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.430379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.430653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.431366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:24.431668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:24.433830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:24.438857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 646/1297] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Feb 15 04:10:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:24.444637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:24.455190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438922a7-f64c-4084-8a4e-ae0c13b14cf6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:24.459690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:24.460321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.460597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.460863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.461672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] RBAC: Adding query filter params (interface=public, service_id=8ecccc2dfa924e95aa42f4b7f3a47628, region_id=RegionOne) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:24.461976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:24.463559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f07e6-9b1f-47a6-b91d-5dc8473f09cf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:24.468484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 652/1298] 10.222.0.45 () {56 vars in 1272 bytes} [Tue Feb 15 04:10:24 2022] GET /identity/v3/endpoints?service_id=8ecccc2dfa924e95aa42f4b7f3a47628&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:24.474017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:24.483993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c887e-8c76-4be4-8d53-386ea8a9f846 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:24.488417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:24.489177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:24.489462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:24.489737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:24.490419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:24.491992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23d76-eb36-49cf-b1ec-31fc42e55d87 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:24.499267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 647/1299] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:10:24 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:10:26.766421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbeeb-545f-4837-b3a9-52e3bbd990b9 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:26.767009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbeeb-545f-4837-b3a9-52e3bbd990b9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:26.767009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cbeeb-545f-4837-b3a9-52e3bbd990b9 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:26.769853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 653/1300] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:10:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:10:26.775215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:26.775652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:26.775777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:26.793794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:10:26.794989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:10:26.802691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 648/1301] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:10:26 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:10:26.827108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cbeeb-545f-4837-b3a9-52e3bbd990b9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:26.839258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cbeeb-545f-4837-b3a9-52e3bbd990b9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:26.843565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:26.844333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:26.844612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:26.844882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:26.845557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:26.847124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:26.858459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING keystone.server.flask.application [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 15 04:10:26.859595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 654/1302] 10.222.0.45 () {56 vars in 1138 bytes} [Tue Feb 15 04:10:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 15 04:10:26.865760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:26.875577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da70b8c-4929-499f-8716-e8ee64802d8c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:26.880107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:26.880757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:26.881080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:26.881358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] PATH_INFO: `/v3/services` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:26.882331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:10:26.882636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:26.884229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6026e1-7fc1-4f58-ae87-97d168e1cdb9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:26.889571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 649/1303] 10.222.0.45 () {56 vars in 1137 bytes} [Tue Feb 15 04:10:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:10:26.895191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:10:26.905941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeec1c2-63e2-447a-945d-06c79cdab119 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:10:26.910391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:10:26.911019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:10:26.911295 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:10:26.911565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:10:26.912301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:10:26.913917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5af0e-10f2-4487-a775-06e20178d8ef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:10:26.931471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 655/1304] 10.222.0.45 () {60 vars in 1165 bytes} [Tue Feb 15 04:10:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:11:36.201029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:36.201551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:36.202017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:36.220390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3f63-6122-466c-b402-656cc8989c84 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:36.221158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3f63-6122-466c-b402-656cc8989c84 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:36.221158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df3f63-6122-466c-b402-656cc8989c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:36.225369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 650/1305] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:36 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:36.380927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d5df3f63-6122-466c-b402-656cc8989c84 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:36.381999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d5df3f63-6122-466c-b402-656cc8989c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:36.525253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 656/1306] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:11:36.550126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:36.551917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:36.732747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1017a-1529-4191-a314-7c7a44647139 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:36.849023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:36.849952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:36.850424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:36.850860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:36.851754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:36.854707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f0207-b854-4ea0-b869-5e167028c6ec admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:36.889408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 651/1307] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:11:36 2022] GET /identity/v3/projects => generated 2553 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:11:39.681165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc16a2-ce1b-41e1-bd71-c427a8ad2b1b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:39.682485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc16a2-ce1b-41e1-bd71-c427a8ad2b1b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:39.682973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc16a2-ce1b-41e1-bd71-c427a8ad2b1b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:39.686346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 657/1308] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:39.694478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba50f-2919-4074-8414-edf18ed28d5b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:39.694973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba50f-2919-4074-8414-edf18ed28d5b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:39.695064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ba50f-2919-4074-8414-edf18ed28d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:39.810272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d98ba50f-2919-4074-8414-edf18ed28d5b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:39.811609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d98ba50f-2919-4074-8414-edf18ed28d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:39.996948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 652/1309] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:40.059839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:40.060122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:40.060376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:40.062317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 658/1310] 10.222.0.45 () {54 vars in 964 bytes} [Tue Feb 15 04:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:40.069650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940856-9641-42e7-89ab-965ccfb82d2f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:40.070092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940856-9641-42e7-89ab-965ccfb82d2f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:40.070509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b940856-9641-42e7-89ab-965ccfb82d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:40.153695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-7b940856-9641-42e7-89ab-965ccfb82d2f None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:40.154832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7b940856-9641-42e7-89ab-965ccfb82d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:40.245834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 653/1311] 10.222.0.45 () {58 vars in 1061 bytes} [Tue Feb 15 04:11:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:40.255431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:40.257062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:40.398653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1262e8-aa4f-410d-8f20-50e3775c626e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:40.477707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:40.478364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:40.478650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:40.478927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:40.480638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:40.606932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:40.608309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d41b6-8a01-4364-b6ce-2fe2bce14225 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:40.627913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 659/1312] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:43.216555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:43.217156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:43.217156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:43.219010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 654/1313] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:43.225163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0071c50-2aa5-4672-aa05-b8561a0f9bdc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:43.225727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0071c50-2aa5-4672-aa05-b8561a0f9bdc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:43.225727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0071c50-2aa5-4672-aa05-b8561a0f9bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:43.298824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d0071c50-2aa5-4672-aa05-b8561a0f9bdc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:43.300039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d0071c50-2aa5-4672-aa05-b8561a0f9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:43.401926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 660/1314] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:43.446696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:43.447344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:43.550412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9175289-7d65-4e43-80be-427bfed07dcc None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:43.636760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:43.637472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:43.637753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:43.638038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:43.639857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:43.761170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:43.762719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ad484-a7ed-4967-b5c3-9c2e367f0ed8 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:43.781758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 655/1315] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:46.345054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:46.345652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:46.345652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:46.347398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 661/1316] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:46.353786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92127b-e892-435e-aae5-c025911f5375 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:46.354215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92127b-e892-435e-aae5-c025911f5375 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:46.354325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92127b-e892-435e-aae5-c025911f5375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:46.421641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-7f92127b-e892-435e-aae5-c025911f5375 None None] MFA Rules not processed for user `e2208699c62945bcabada032ea5b0722`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:46.422860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7f92127b-e892-435e-aae5-c025911f5375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:46.516928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 656/1317] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:46.557139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:46.558671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:46.661922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368440c-a27d-4bf1-8f26-a746b7360597 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:46.737092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:46.737768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:46.738050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:46.738325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:46.739975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:46.849316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:46.850771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63185393-be01-4e9a-84a9-3e43bb068c46 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:46.870149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 662/1318] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:49.736770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:49.737230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:49.737340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:49.739123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 657/1319] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:49.744920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4635-dec0-4055-bb67-0db0164cc771 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:49.745351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4635-dec0-4055-bb67-0db0164cc771 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:49.745442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a4635-dec0-4055-bb67-0db0164cc771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:49.808994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fd4a4635-dec0-4055-bb67-0db0164cc771 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:49.810176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fd4a4635-dec0-4055-bb67-0db0164cc771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:49.903910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 663/1320] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:11:49.942259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:49.943765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:50.046395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e5e06-280f-4c9f-821b-a4afa8e8577d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:50.117000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:50.118457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:50.118921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:50.119199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:50.120828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:50.230383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:50.231818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6cdbb-f271-40c0-b7f6-aa6caf5ffcf7 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:50.249453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 658/1321] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:53.224084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:53.224718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:53.224718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:53.226429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 664/1322] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:53.233162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641178a-d432-452e-bf95-eceb887789a1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:53.233672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641178a-d432-452e-bf95-eceb887789a1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:53.233782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641178a-d432-452e-bf95-eceb887789a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:53.298782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2641178a-d432-452e-bf95-eceb887789a1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:53.299970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2641178a-d432-452e-bf95-eceb887789a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:53.395156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 659/1323] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:53.432420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:53.434027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:53.542172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91337a-facc-4e14-8a6f-822c2de01936 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:53.617413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:53.618203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:53.618484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:53.618755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:53.620419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:53.735757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:53.737250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6c337-dbf6-4b17-8558-6b2d4e7321a9 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:53.759318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 665/1324] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:56.098974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:56.099519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:56.099519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:56.102155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 660/1325] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:56.108482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1acf3f-a8bc-4d8a-9f88-9190f29c38f3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:56.109093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1acf3f-a8bc-4d8a-9f88-9190f29c38f3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:56.109093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1acf3f-a8bc-4d8a-9f88-9190f29c38f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:56.184997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5b1acf3f-a8bc-4d8a-9f88-9190f29c38f3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:56.186209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5b1acf3f-a8bc-4d8a-9f88-9190f29c38f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:56.287735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 666/1326] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:56.331741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:56.333335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:56.438752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6113-eed5-4a03-97dd-68efab0dee89 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:56.510551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:56.511200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:56.511768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:56.512058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:56.513753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:56.632621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:56.634110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e6c77-0791-4832-839d-87734e22d935 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:56.653962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 661/1327] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:11:59.010316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:59.010846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:59.010846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:59.012764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 667/1328] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:11:59.018271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916649eb-e65e-44e5-bffc-5083f2f3c2fb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:59.018828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916649eb-e65e-44e5-bffc-5083f2f3c2fb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:59.018828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916649eb-e65e-44e5-bffc-5083f2f3c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:59.097283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-916649eb-e65e-44e5-bffc-5083f2f3c2fb None None] MFA Rules not processed for user `e2208699c62945bcabada032ea5b0722`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:11:59.098854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-916649eb-e65e-44e5-bffc-5083f2f3c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:59.213988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 662/1329] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:11:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:11:59.252681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:11:59.254245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:59.359529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da24cc-0021-437d-950d-c4b008ec2966 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:11:59.435933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:11:59.436577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:11:59.436879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:11:59.437165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:11:59.438791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:11:59.551923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:11:59.553408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebbf05c-45b9-4ab1-a6a1-68dd4612e9fb service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:11:59.572581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 668/1330] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:11:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:02.129503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:02.130055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:02.130055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:02.131882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 663/1331] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:02.137954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c20ef-5790-4951-95db-f2ce4128d33a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:02.138402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c20ef-5790-4951-95db-f2ce4128d33a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:02.138517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c20ef-5790-4951-95db-f2ce4128d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:02.205910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-555c20ef-5790-4951-95db-f2ce4128d33a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:02.207120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-555c20ef-5790-4951-95db-f2ce4128d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:02.312155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 669/1332] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:02.349186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:02.350740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:02.482921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6ba05-dc5f-42cd-8b39-a74179747cd5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:02.580178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:02.580842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:02.581155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:02.581429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:02.583091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:02.724763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:02.727675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344d2b5-e3a4-49df-9795-4953f0f5494e service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:02.753257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 664/1333] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:05.119323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042befcc-7753-4acf-a3ec-90d78446f794 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:05.119838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042befcc-7753-4acf-a3ec-90d78446f794 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:05.119838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042befcc-7753-4acf-a3ec-90d78446f794 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:05.121744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 670/1334] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:05.126971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dddc2-f83f-49c6-bf57-eb17d9783ffb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:05.127451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dddc2-f83f-49c6-bf57-eb17d9783ffb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:05.127546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dddc2-f83f-49c6-bf57-eb17d9783ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:05.191703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-889dddc2-f83f-49c6-bf57-eb17d9783ffb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:05.192886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-889dddc2-f83f-49c6-bf57-eb17d9783ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:05.286413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 665/1335] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:05.344044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:05.344325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:05.344601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:05.346402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 671/1336] 10.222.0.45 () {54 vars in 964 bytes} [Tue Feb 15 04:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:05.352535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8106-08f7-47af-ba5a-85b80fd42155 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:05.352823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8106-08f7-47af-ba5a-85b80fd42155 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:05.353239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c8106-08f7-47af-ba5a-85b80fd42155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:05.427322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-202c8106-08f7-47af-ba5a-85b80fd42155 None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:05.428553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-202c8106-08f7-47af-ba5a-85b80fd42155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:05.502101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 666/1337] 10.222.0.45 () {58 vars in 1061 bytes} [Tue Feb 15 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:05.512473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:05.514051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:05.616448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91f811-0ee4-45fc-9734-56cfccdf0e89 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:05.690703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:05.691265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:05.691550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:05.691825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:05.693500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:05.803706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:05.805819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a72b-5da6-4232-8c26-2bd2e3b10ca8 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:05.826050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 672/1338] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:08.970087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:08.970655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:08.970655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:08.972482 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 667/1339] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:08.978600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8457-5bbf-4f88-b70d-0db8526f4654 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:08.979089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8457-5bbf-4f88-b70d-0db8526f4654 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:08.979195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc8457-5bbf-4f88-b70d-0db8526f4654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:09.055509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-64bc8457-5bbf-4f88-b70d-0db8526f4654 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:09.056691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-64bc8457-5bbf-4f88-b70d-0db8526f4654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:09.172803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 673/1340] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:09.213361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:09.215557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:09.316792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2103d6-5034-4521-9f38-c3842d9bd759 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:09.320480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:09.321159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:09.321450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:09.321731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:09.330885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:09.332791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248e54b-cf6b-47cb-bb3e-f73ca424029d service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:09.343354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 668/1341] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:13.670604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba43b7-8bb0-4b4f-9e3d-d31dee93aab5 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:13.671379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba43b7-8bb0-4b4f-9e3d-d31dee93aab5 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:13.671379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba43b7-8bb0-4b4f-9e3d-d31dee93aab5 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:13.673006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 674/1342] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:13.678793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7a0f-0e66-4e23-8c63-996d1f21c909 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:13.679847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7a0f-0e66-4e23-8c63-996d1f21c909 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:13.680175 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e7a0f-0e66-4e23-8c63-996d1f21c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:13.712451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c95e7a0f-0e66-4e23-8c63-996d1f21c909 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:13.714563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c95e7a0f-0e66-4e23-8c63-996d1f21c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:13.845128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 669/1343] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:13.888449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba43b7-8bb0-4b4f-9e3d-d31dee93aab5 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:13.900505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba43b7-8bb0-4b4f-9e3d-d31dee93aab5 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:13.905095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:13.905939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:13.906370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:13.906790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:13.917186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:13.918640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec307a6c-85fa-47f2-9065-bbfc89419e24 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:13.930170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 675/1344] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:12:16.902694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08826e3-7999-4220-a2b5-ab87dddf004b None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:16.903277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08826e3-7999-4220-a2b5-ab87dddf004b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:16.903277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08826e3-7999-4220-a2b5-ab87dddf004b None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:16.905139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 670/1345] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:16.910591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c3f9-5b4f-4039-9754-7310c9d258fe None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:16.911106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c3f9-5b4f-4039-9754-7310c9d258fe None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:16.911198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1c3f9-5b4f-4039-9754-7310c9d258fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:16.930511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f3f1c3f9-5b4f-4039-9754-7310c9d258fe None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:16.931709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f3f1c3f9-5b4f-4039-9754-7310c9d258fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:16.939863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 676/1346] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:16.979651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08826e3-7999-4220-a2b5-ab87dddf004b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:16.990485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08826e3-7999-4220-a2b5-ab87dddf004b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:16.995030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:16.995734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:16.996068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:16.996294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:17.005928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:17.007977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ecf88-205c-40a4-bc08-660ea2e09d41 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:17.018322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 671/1347] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:21.648161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa1a5-6361-4f7d-acad-9cf6611dfcb4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:21.648708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa1a5-6361-4f7d-acad-9cf6611dfcb4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:21.648708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa1a5-6361-4f7d-acad-9cf6611dfcb4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:21.650434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 677/1348] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:21.655907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31302-c16d-4043-95ce-ec07086ea59a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:21.656513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31302-c16d-4043-95ce-ec07086ea59a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:21.656513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff31302-c16d-4043-95ce-ec07086ea59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:21.682089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-eff31302-c16d-4043-95ce-ec07086ea59a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:21.683288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-eff31302-c16d-4043-95ce-ec07086ea59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:21.691698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 672/1349] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:21.730503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa1a5-6361-4f7d-acad-9cf6611dfcb4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:21.740983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa1a5-6361-4f7d-acad-9cf6611dfcb4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:21.745087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:21.745719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:21.746003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:21.746365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:21.756195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:21.757905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeb883-64af-4e81-982e-7d7078cd833b service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:21.768783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 678/1350] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:27.729480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c3fc-3e73-4823-8973-6488345a680c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:27.730137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c3fc-3e73-4823-8973-6488345a680c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:27.730137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18c3fc-3e73-4823-8973-6488345a680c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:27.733377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 673/1351] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:12:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:27.742623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a8bd-e961-4644-8c83-a38faffae7cd None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:27.743515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a8bd-e961-4644-8c83-a38faffae7cd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:27.743957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0a8bd-e961-4644-8c83-a38faffae7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:27.962862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5dc0a8bd-e961-4644-8c83-a38faffae7cd None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:27.964800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5dc0a8bd-e961-4644-8c83-a38faffae7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:28.059757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 679/1352] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:12:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:12:33.197248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8aa-2859-4411-923c-34e7d771a3ab None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:33.198447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8aa-2859-4411-923c-34e7d771a3ab None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:33.199038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402f8aa-2859-4411-923c-34e7d771a3ab None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:33.201426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 674/1353] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:12:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:33.209085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb282e-3366-4e6e-bdfe-22e6aba33611 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:33.211102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb282e-3366-4e6e-bdfe-22e6aba33611 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:33.211416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb282e-3366-4e6e-bdfe-22e6aba33611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:33.232384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-63bb282e-3366-4e6e-bdfe-22e6aba33611 None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:33.233636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-63bb282e-3366-4e6e-bdfe-22e6aba33611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:33.243849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 680/1354] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:12:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:34.445764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d480e-0be4-46e0-9913-41dec61655ed None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:34.446598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d480e-0be4-46e0-9913-41dec61655ed None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:34.446598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d480e-0be4-46e0-9913-41dec61655ed None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:34.448436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 675/1355] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:12:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:34.457886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7304f-6a95-415f-bb1e-2741faaec8a8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:34.458416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7304f-6a95-415f-bb1e-2741faaec8a8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:34.458901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7304f-6a95-415f-bb1e-2741faaec8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:34.490180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d0d7304f-6a95-415f-bb1e-2741faaec8a8 None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:34.492363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d0d7304f-6a95-415f-bb1e-2741faaec8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:34.505654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 681/1356] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:12:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:38.733356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8afe9-1b0c-4e2b-a212-0a98bb81edeb None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:38.733898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8afe9-1b0c-4e2b-a212-0a98bb81edeb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:38.733898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8afe9-1b0c-4e2b-a212-0a98bb81edeb None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:38.739346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 676/1357] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:38.746580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648f0f-3b1a-40bd-9f18-170779a94503 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:38.747725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648f0f-3b1a-40bd-9f18-170779a94503 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:38.747725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72648f0f-3b1a-40bd-9f18-170779a94503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:38.785111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-72648f0f-3b1a-40bd-9f18-170779a94503 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:38.786341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-72648f0f-3b1a-40bd-9f18-170779a94503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:38.795729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 682/1358] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:38.851823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9e02-e8b7-49cf-85c8-820e8a6c12b0 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:38.852106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9e02-e8b7-49cf-85c8-820e8a6c12b0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:38.852387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee9e02-e8b7-49cf-85c8-820e8a6c12b0 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:38.854241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 677/1359] 10.222.0.45 () {54 vars in 961 bytes} [Tue Feb 15 04:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:38.860725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e754a7-85ea-451a-8757-031b2121c44d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:38.861376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e754a7-85ea-451a-8757-031b2121c44d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:38.861657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e754a7-85ea-451a-8757-031b2121c44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:38.940014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c0e754a7-85ea-451a-8757-031b2121c44d None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:38.941470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c0e754a7-85ea-451a-8757-031b2121c44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:39.046114 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 683/1360] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Feb 15 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:39.056850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee9e02-e8b7-49cf-85c8-820e8a6c12b0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:39.072248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee9e02-e8b7-49cf-85c8-820e8a6c12b0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:39.078181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:39.079065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:39.079495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:39.079956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:39.089747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:39.092367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ed393-c423-4b82-b182-a080124f388f service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:39.104749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 678/1361] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:42.065099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2acc1-8678-4612-b4e7-122901aecab6 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:42.066220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2acc1-8678-4612-b4e7-122901aecab6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:42.066725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2acc1-8678-4612-b4e7-122901aecab6 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:42.069700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 684/1362] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:42.076252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53375-0251-437b-92a7-81e9632666d5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:42.077125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53375-0251-437b-92a7-81e9632666d5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:42.077302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f53375-0251-437b-92a7-81e9632666d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:42.098274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-47f53375-0251-437b-92a7-81e9632666d5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:42.100693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-47f53375-0251-437b-92a7-81e9632666d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:42.109604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 679/1363] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:42.158117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2acc1-8678-4612-b4e7-122901aecab6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:42.174241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2acc1-8678-4612-b4e7-122901aecab6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:42.181033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:42.181771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:42.182128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:42.182474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:42.192053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:42.194396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204ba7-1f81-4682-9ca6-0b7cf6837ed6 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:42.205777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 685/1364] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:44.892716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c176da-8ce4-4b57-b449-05c683349bfd None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:44.893361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c176da-8ce4-4b57-b449-05c683349bfd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:44.893361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c176da-8ce4-4b57-b449-05c683349bfd None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:44.894984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 680/1365] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:44.901657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34022d-3d24-4368-99e1-ad91b36441ea None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:44.902382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34022d-3d24-4368-99e1-ad91b36441ea None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:44.902576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34022d-3d24-4368-99e1-ad91b36441ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:44.927696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9a34022d-3d24-4368-99e1-ad91b36441ea None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:44.928925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9a34022d-3d24-4368-99e1-ad91b36441ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:44.937020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 686/1366] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:44.988123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a2da0-1844-4793-8558-ede6bc09efe7 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:44.988467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a2da0-1844-4793-8558-ede6bc09efe7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:44.988937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a2da0-1844-4793-8558-ede6bc09efe7 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:44.990894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 681/1367] 10.222.0.45 () {54 vars in 961 bytes} [Tue Feb 15 04:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:44.999497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011156-10a9-40be-bfde-d8676bddf61b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:44.999858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011156-10a9-40be-bfde-d8676bddf61b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:45.000201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77011156-10a9-40be-bfde-d8676bddf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:45.022210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-77011156-10a9-40be-bfde-d8676bddf61b None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:45.023637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-77011156-10a9-40be-bfde-d8676bddf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:45.033816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 687/1368] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Feb 15 04:12:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:12:45.044950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a2da0-1844-4793-8558-ede6bc09efe7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:45.061039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a2da0-1844-4793-8558-ede6bc09efe7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:45.067778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:45.068571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:45.069080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:45.069400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:45.078585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:45.080176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002e51c-784b-4236-9ecd-efd9a844f6c4 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:45.092193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 682/1369] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:12:47.556253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777716-50c7-4203-a436-dabe21680643 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:47.556790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777716-50c7-4203-a436-dabe21680643 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:47.557380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777716-50c7-4203-a436-dabe21680643 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:47.559857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 688/1370] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:47.565734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a71-373c-4898-acd4-60f2c400a992 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:47.566446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a71-373c-4898-acd4-60f2c400a992 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:47.566446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a71-373c-4898-acd4-60f2c400a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:47.601472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-dc2d1a71-373c-4898-acd4-60f2c400a992 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:47.603916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dc2d1a71-373c-4898-acd4-60f2c400a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:47.619083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 683/1371] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:12:47.668824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777716-50c7-4203-a436-dabe21680643 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:47.685968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89777716-50c7-4203-a436-dabe21680643 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:47.692066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:47.693072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:47.693562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:47.694059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:47.703610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:47.705285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebfb0a-1076-4ee2-8fa1-5634874cebad service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:47.718789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 689/1372] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:47.771896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e6fe-8058-4315-b94f-ae9abf66aa35 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:47.772312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e6fe-8058-4315-b94f-ae9abf66aa35 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:47.772887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666e6fe-8058-4315-b94f-ae9abf66aa35 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:47.775955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 684/1373] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:47.782156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79051-8cfe-404e-86d9-f5c19a856bd3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:47.782450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79051-8cfe-404e-86d9-f5c19a856bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:47.782732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e79051-8cfe-404e-86d9-f5c19a856bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:47.803697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-42e79051-8cfe-404e-86d9-f5c19a856bd3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:47.804944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-42e79051-8cfe-404e-86d9-f5c19a856bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:47.815869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 690/1374] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:48.084614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576212-978b-41b3-b2bc-fcbc977b2070 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:48.084821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576212-978b-41b3-b2bc-fcbc977b2070 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:48.085115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c576212-978b-41b3-b2bc-fcbc977b2070 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:48.086947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 685/1375] 10.222.0.45 () {54 vars in 963 bytes} [Tue Feb 15 04:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:48.092707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564075ca-b2aa-42f3-a617-0823305dce81 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:48.093056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564075ca-b2aa-42f3-a617-0823305dce81 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:48.093342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564075ca-b2aa-42f3-a617-0823305dce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:48.147842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-564075ca-b2aa-42f3-a617-0823305dce81 None None] MFA Rules not processed for user `920aa75581fb41b0b6b09e07399a01b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:48.149252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-564075ca-b2aa-42f3-a617-0823305dce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:48.216931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 691/1376] 10.222.0.45 () {58 vars in 1060 bytes} [Tue Feb 15 04:12:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:12:48.224717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576212-978b-41b3-b2bc-fcbc977b2070 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:48.235467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c576212-978b-41b3-b2bc-fcbc977b2070 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:48.239036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:48.239678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:48.240807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:48.240807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:48.250186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:48.251652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e018b04-2ac7-4a4a-8ffa-3776e8a0749a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:48.262699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 686/1377] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:50.407370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aa7e-2238-4bcd-bb4c-94a928dfef56 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:50.407891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aa7e-2238-4bcd-bb4c-94a928dfef56 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:50.407982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95aa7e-2238-4bcd-bb4c-94a928dfef56 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:50.409745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 692/1378] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:50.416319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ca86-2995-4b22-867f-f9d4839486a8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:50.417387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ca86-2995-4b22-867f-f9d4839486a8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:50.417387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18ca86-2995-4b22-867f-f9d4839486a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:50.437408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ba18ca86-2995-4b22-867f-f9d4839486a8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:50.438629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ba18ca86-2995-4b22-867f-f9d4839486a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:50.447378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 687/1379] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:50.494404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95aa7e-2238-4bcd-bb4c-94a928dfef56 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:50.516083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95aa7e-2238-4bcd-bb4c-94a928dfef56 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:50.522254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:50.522908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:50.523187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:50.523461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:50.533180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:50.534769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c9b6b0-1383-440d-a8e9-8956f8f5a4f4 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:50.547235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 693/1380] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:53.097938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3595-9f2c-498f-a379-74c44b94539b None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:53.098854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3595-9f2c-498f-a379-74c44b94539b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:53.098854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d3595-9f2c-498f-a379-74c44b94539b None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:53.101363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 688/1381] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:53.108373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2123-d980-4ce4-9c2d-d5263f983cde None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:53.108969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2123-d980-4ce4-9c2d-d5263f983cde None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:53.108969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f2123-d980-4ce4-9c2d-d5263f983cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:53.129448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4c7f2123-d980-4ce4-9c2d-d5263f983cde None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:53.130723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4c7f2123-d980-4ce4-9c2d-d5263f983cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:53.143827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 694/1382] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:53.196101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d3595-9f2c-498f-a379-74c44b94539b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:53.212324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d3595-9f2c-498f-a379-74c44b94539b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:53.218464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:53.219144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:53.219429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:53.219707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:53.229474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:53.231056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c5df32-6407-4695-932c-726ecfef3325 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:53.241689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 689/1383] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:12:56.092250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02781-9f2b-41e6-82c1-091a24d62c44 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:56.093201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02781-9f2b-41e6-82c1-091a24d62c44 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:56.093558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f02781-9f2b-41e6-82c1-091a24d62c44 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:56.095415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 695/1384] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:12:56.104772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dea-97df-452c-9637-44136f24310b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:56.105889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dea-97df-452c-9637-44136f24310b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:56.106353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96dea-97df-452c-9637-44136f24310b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:56.131287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-aee96dea-97df-452c-9637-44136f24310b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:56.132798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-aee96dea-97df-452c-9637-44136f24310b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:56.142720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 690/1385] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:56.214095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02781-9f2b-41e6-82c1-091a24d62c44 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:56.231072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f02781-9f2b-41e6-82c1-091a24d62c44 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:56.238213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:56.238909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:56.239199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:56.239468 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:56.250779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:56.252946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a481018-0bc0-44b1-86d6-705ac038ce3f service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:56.268801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 696/1386] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:12:59.091846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f1a9-27e9-4dd5-87a2-d08e422346c5 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:59.092370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f1a9-27e9-4dd5-87a2-d08e422346c5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:59.092370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8f1a9-27e9-4dd5-87a2-d08e422346c5 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:59.094136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 691/1387] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:12:59.099753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c332-7aba-4018-865f-d5e2d3d72188 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:59.100237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c332-7aba-4018-865f-d5e2d3d72188 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:59.100438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27c332-7aba-4018-865f-d5e2d3d72188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:59.120201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5f27c332-7aba-4018-865f-d5e2d3d72188 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:12:59.121625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5f27c332-7aba-4018-865f-d5e2d3d72188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:12:59.132248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 697/1388] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:12:59.178367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8f1a9-27e9-4dd5-87a2-d08e422346c5 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:12:59.195258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8f1a9-27e9-4dd5-87a2-d08e422346c5 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:12:59.204751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:12:59.205522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:12:59.206133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:12:59.206278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:12:59.216435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:12:59.218147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196397fd-ffd4-4fa4-a75b-b39e3f96a9ed service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:12:59.233709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 692/1389] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:01.541266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a355d3-9c47-49d1-987b-79bdf55ff133 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:01.541824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a355d3-9c47-49d1-987b-79bdf55ff133 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:01.541824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a355d3-9c47-49d1-987b-79bdf55ff133 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:01.543626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 698/1390] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:01.549339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e62ba-b6b3-4119-af6b-a9fcc4825dba None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:01.549794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e62ba-b6b3-4119-af6b-a9fcc4825dba None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:01.549906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e62ba-b6b3-4119-af6b-a9fcc4825dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:01.568846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-365e62ba-b6b3-4119-af6b-a9fcc4825dba None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:01.570134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-365e62ba-b6b3-4119-af6b-a9fcc4825dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:01.579593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 693/1391] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:01.624690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a355d3-9c47-49d1-987b-79bdf55ff133 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:01.640151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a355d3-9c47-49d1-987b-79bdf55ff133 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:01.645550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:01.646728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:01.647031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:01.647265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:01.657175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:01.658810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f0f1a-6dc9-408a-8096-3c01c2b31497 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:01.669270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 699/1392] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:04.020202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd733b-6cf2-4f08-bf32-7b92b3cdaf0c None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:04.022032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd733b-6cf2-4f08-bf32-7b92b3cdaf0c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:04.022032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd733b-6cf2-4f08-bf32-7b92b3cdaf0c None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:04.024040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 694/1393] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:13:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:04.030497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca5f-71a2-420d-84c8-3ab0a1e4951a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:04.031004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca5f-71a2-420d-84c8-3ab0a1e4951a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:04.031115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ca5f-71a2-420d-84c8-3ab0a1e4951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:04.048962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-2ca6ca5f-71a2-420d-84c8-3ab0a1e4951a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:04.050376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2ca6ca5f-71a2-420d-84c8-3ab0a1e4951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:04.058887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 700/1394] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:04.104932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd733b-6cf2-4f08-bf32-7b92b3cdaf0c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:04.119292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd733b-6cf2-4f08-bf32-7b92b3cdaf0c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:04.124660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:04.125346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:04.125629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:04.125901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:04.135654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:04.137300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0abcd03-d13c-4bb4-aad3-4ebeef4b63c9 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:04.147844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 695/1395] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:06.449426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317911f-789d-461e-b6ab-ffe6e407856b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:06.450029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317911f-789d-461e-b6ab-ffe6e407856b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:06.450029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317911f-789d-461e-b6ab-ffe6e407856b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:06.452168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 701/1396] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:06.458385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15731-1e6f-49d1-90c7-71c0280d8d2a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:06.458873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15731-1e6f-49d1-90c7-71c0280d8d2a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:06.458963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15731-1e6f-49d1-90c7-71c0280d8d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:06.479201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-87b15731-1e6f-49d1-90c7-71c0280d8d2a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:06.480416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-87b15731-1e6f-49d1-90c7-71c0280d8d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:06.488346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 696/1397] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:06.537778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317911f-789d-461e-b6ab-ffe6e407856b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:06.553152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317911f-789d-461e-b6ab-ffe6e407856b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:06.558937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:06.559585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:06.559869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:06.560128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:06.569740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:06.572516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a34b5a-b727-4a82-aa70-518729eccab6 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:06.587252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 702/1398] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:08.227463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741d2b-93b7-4552-800b-a69d8df53b10 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.228053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741d2b-93b7-4552-800b-a69d8df53b10 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.228157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88741d2b-93b7-4552-800b-a69d8df53b10 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.229943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 697/1399] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:08.236274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5091c-858d-48fa-8f3d-181c16afadaf None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.236926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5091c-858d-48fa-8f3d-181c16afadaf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.237388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5091c-858d-48fa-8f3d-181c16afadaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.259283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d2c5091c-858d-48fa-8f3d-181c16afadaf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:08.260510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d2c5091c-858d-48fa-8f3d-181c16afadaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:08.268934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 703/1400] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:08.330721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ea06-6dc6-4b93-a6f6-d218a5301861 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.331040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ea06-6dc6-4b93-a6f6-d218a5301861 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.331326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ea06-6dc6-4b93-a6f6-d218a5301861 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.333145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 698/1401] 10.222.0.45 () {54 vars in 962 bytes} [Tue Feb 15 04:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:13:08.339386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aaadd-362a-4ba4-9318-b3f1152ed55a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.339792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aaadd-362a-4ba4-9318-b3f1152ed55a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.340250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aaadd-362a-4ba4-9318-b3f1152ed55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.409347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3e2aaadd-362a-4ba4-9318-b3f1152ed55a None None] MFA Rules not processed for user `7a77604b8ff64cf883d700d2563ab131`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:08.411304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3e2aaadd-362a-4ba4-9318-b3f1152ed55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:08.491467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 704/1402] 10.222.0.45 () {58 vars in 1059 bytes} [Tue Feb 15 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:08.501257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ea06-6dc6-4b93-a6f6-d218a5301861 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:08.514167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ea06-6dc6-4b93-a6f6-d218a5301861 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:08.518064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:08.518767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.519080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.519361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.529621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:08.531064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21d88-f606-4b0f-9478-698fbcbec886 service glance] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:08.543628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 699/1403] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:08.913585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4b32-23c9-475d-9107-1042fd8aeb5d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.913860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4b32-23c9-475d-9107-1042fd8aeb5d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.914141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4b32-23c9-475d-9107-1042fd8aeb5d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.915932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 705/1404] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:13:08.921847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c97fd-deeb-48d9-81a0-086b8617cf01 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:08.922136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c97fd-deeb-48d9-81a0-086b8617cf01 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:08.922410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c97fd-deeb-48d9-81a0-086b8617cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:08.947878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6a4c97fd-deeb-48d9-81a0-086b8617cf01 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:08.949142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6a4c97fd-deeb-48d9-81a0-086b8617cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:08.962350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 700/1405] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:09.014868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4b32-23c9-475d-9107-1042fd8aeb5d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:09.019879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ca57-d759-4be7-ba1f-d4a1e2c8dc28 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:09.020154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ca57-d759-4be7-ba1f-d4a1e2c8dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:09.020433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ca57-d759-4be7-ba1f-d4a1e2c8dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:09.034227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4b32-23c9-475d-9107-1042fd8aeb5d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:09.041506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:09.042160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:09.042435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:09.042705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:09.054653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:09.056433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b253c92-996d-45f4-83ea-d73f12e7ac56 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:09.069403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 706/1406] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:09.075809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2fc2ca57-d759-4be7-ba1f-d4a1e2c8dc28 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:09.077033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2fc2ca57-d759-4be7-ba1f-d4a1e2c8dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:09.151142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 701/1407] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:13:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:13:09.208517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08548-282f-4c24-ae05-8cee1ff7279f None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:09.208517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08548-282f-4c24-ae05-8cee1ff7279f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:09.208517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c08548-282f-4c24-ae05-8cee1ff7279f None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:09.210460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 707/1408] 10.222.0.45 () {54 vars in 942 bytes} [Tue Feb 15 04:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:09.217600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b06b6-07fe-45d6-a1ec-6d83ba1a1309 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:09.217979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b06b6-07fe-45d6-a1ec-6d83ba1a1309 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:09.218406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b06b6-07fe-45d6-a1ec-6d83ba1a1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:09.286382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f01b06b6-07fe-45d6-a1ec-6d83ba1a1309 None None] MFA Rules not processed for user `d4d68bfed8d44a77a98bb887be0efd05`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:09.288985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f01b06b6-07fe-45d6-a1ec-6d83ba1a1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:09.391433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 702/1409] 10.222.0.45 () {58 vars in 1039 bytes} [Tue Feb 15 04:13:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:09.401212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08548-282f-4c24-ae05-8cee1ff7279f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:09.415712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c08548-282f-4c24-ae05-8cee1ff7279f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:09.420804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46102584-039f-477b-a766-b22de6420b3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:09.421470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102584-039f-477b-a766-b22de6420b3b service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:09.421748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102584-039f-477b-a766-b22de6420b3b service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:09.422019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46102584-039f-477b-a766-b22de6420b3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:09.431730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46102584-039f-477b-a766-b22de6420b3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:09.433368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46102584-039f-477b-a766-b22de6420b3b service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:09.441971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 708/1410] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:13:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:13:32.269779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0eb9-d83b-419f-bd14-901122a56a1d None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:32.270379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0eb9-d83b-419f-bd14-901122a56a1d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:32.270379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda0eb9-d83b-419f-bd14-901122a56a1d None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:32.272201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 703/1411] 10.222.0.45 () {54 vars in 918 bytes} [Tue Feb 15 04:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:32.277540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae9c0-850c-44c0-8f26-d6b8fdd1d5bd None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:32.278017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae9c0-850c-44c0-8f26-d6b8fdd1d5bd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:32.278139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fae9c0-850c-44c0-8f26-d6b8fdd1d5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:32.297213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-75fae9c0-850c-44c0-8f26-d6b8fdd1d5bd None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:32.298411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-75fae9c0-850c-44c0-8f26-d6b8fdd1d5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:32.307415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 709/1412] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Feb 15 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:32.323205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4205a-47b5-46e2-8b8d-40af6cdd6680 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:32.323497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4205a-47b5-46e2-8b8d-40af6cdd6680 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:32.323777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4205a-47b5-46e2-8b8d-40af6cdd6680 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:32.325572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 704/1413] 10.222.0.45 () {54 vars in 918 bytes} [Tue Feb 15 04:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:32.330782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b9d8-5639-4dc4-8e07-cbfbd5b47337 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:32.331145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b9d8-5639-4dc4-8e07-cbfbd5b47337 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:32.331427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a8b9d8-5639-4dc4-8e07-cbfbd5b47337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:32.349729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-20a8b9d8-5639-4dc4-8e07-cbfbd5b47337 None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:32.350926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-20a8b9d8-5639-4dc4-8e07-cbfbd5b47337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:32.360420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 710/1414] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Feb 15 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:35.073906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc135-6024-4a00-a267-43d37af8ad3e None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:35.074488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc135-6024-4a00-a267-43d37af8ad3e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:35.074488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2cc135-6024-4a00-a267-43d37af8ad3e None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:35.076228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 705/1415] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:35.081709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b465-ce56-42d4-ac35-f4e40d3f337c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:35.082189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b465-ce56-42d4-ac35-f4e40d3f337c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:35.082307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f8b465-ce56-42d4-ac35-f4e40d3f337c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:35.100567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-86f8b465-ce56-42d4-ac35-f4e40d3f337c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:35.101772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-86f8b465-ce56-42d4-ac35-f4e40d3f337c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:35.109755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 711/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:35.154560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc135-6024-4a00-a267-43d37af8ad3e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:35.170189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2cc135-6024-4a00-a267-43d37af8ad3e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:35.175766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:35.176432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:35.176784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:35.177282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:35.186456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:35.188081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd184edc-8cc3-4a79-8531-8906318faa92 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:35.198809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 706/1417] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:36.595725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960829d-276c-4484-ba2d-0461c4223ecc None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:36.596288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960829d-276c-4484-ba2d-0461c4223ecc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:36.596288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960829d-276c-4484-ba2d-0461c4223ecc None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:36.598264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:36.603642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272646d7-b5bc-4736-9099-8e9e386b8294 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:36.604172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272646d7-b5bc-4736-9099-8e9e386b8294 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:36.604172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272646d7-b5bc-4736-9099-8e9e386b8294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:36.622595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-272646d7-b5bc-4736-9099-8e9e386b8294 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:36.623787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-272646d7-b5bc-4736-9099-8e9e386b8294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:36.632422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:36.785157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960829d-276c-4484-ba2d-0461c4223ecc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:36.799314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960829d-276c-4484-ba2d-0461c4223ecc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:36.805628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:36.806252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:36.806568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:36.806799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:36.815513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:36.817110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c66bb-bf1a-4a31-b7b4-6e0f3d23a6aa service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:36.827195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 713/1420] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:38.229830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fcf8-958e-4268-804a-e69587ba3d61 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:38.230407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fcf8-958e-4268-804a-e69587ba3d61 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:38.230407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00fcf8-958e-4268-804a-e69587ba3d61 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:38.233003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:38.238584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f852a-d928-43c7-9aa5-d1c555b5086e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:38.239577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f852a-d928-43c7-9aa5-d1c555b5086e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:38.239730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f852a-d928-43c7-9aa5-d1c555b5086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:38.260879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8d4f852a-d928-43c7-9aa5-d1c555b5086e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:38.262026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8d4f852a-d928-43c7-9aa5-d1c555b5086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:38.272151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:38.452955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00fcf8-958e-4268-804a-e69587ba3d61 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:38.471811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00fcf8-958e-4268-804a-e69587ba3d61 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:38.478414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:38.479076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:38.479359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:38.479682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:38.488771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:38.490827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c9b8f-e730-46af-a32e-de7344c85730 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:38.502289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 709/1423] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:13:39.840751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc0b7-2f75-4262-aa45-dd6606239b90 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:39.841329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc0b7-2f75-4262-aa45-dd6606239b90 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:39.841423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc0b7-2f75-4262-aa45-dd6606239b90 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:39.843121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:39.848258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e54097-332d-4e15-bbef-cf73941c59fc None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:39.849835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e54097-332d-4e15-bbef-cf73941c59fc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:39.850127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e54097-332d-4e15-bbef-cf73941c59fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:39.869737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-16e54097-332d-4e15-bbef-cf73941c59fc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:39.870919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-16e54097-332d-4e15-bbef-cf73941c59fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:39.878889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:40.035395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc0b7-2f75-4262-aa45-dd6606239b90 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:40.049458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc0b7-2f75-4262-aa45-dd6606239b90 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:40.056583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:40.057255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:40.057541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:40.057824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:40.066401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:40.068507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dd13f-9b91-4653-aed4-06e4915dbf4c service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:40.077844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 716/1426] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:41.410526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf000a5-6538-466d-b19f-86bbd1e8c570 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:41.411189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf000a5-6538-466d-b19f-86bbd1e8c570 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:41.411189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf000a5-6538-466d-b19f-86bbd1e8c570 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:41.413298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:41.418280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e739c-2c3c-4860-9507-1bdb861734c2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:41.418733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e739c-2c3c-4860-9507-1bdb861734c2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:41.418840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e739c-2c3c-4860-9507-1bdb861734c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:41.437328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a34e739c-2c3c-4860-9507-1bdb861734c2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:41.438504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a34e739c-2c3c-4860-9507-1bdb861734c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:41.446923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:41.605360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf000a5-6538-466d-b19f-86bbd1e8c570 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:41.620430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf000a5-6538-466d-b19f-86bbd1e8c570 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:41.625881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:41.626524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:41.626808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:41.627087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:41.635939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:41.637568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c888e6-70ff-4aa9-9c85-0ee015060a5e service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:41.647292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 712/1429] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:42.938688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103db4-91c8-45db-bcaf-3f25904dc3b0 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:42.939274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103db4-91c8-45db-bcaf-3f25904dc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:42.939274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e103db4-91c8-45db-bcaf-3f25904dc3b0 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:42.941045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:42.946625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4610f-d169-4c65-acb7-f271be2444d2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:42.947088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4610f-d169-4c65-acb7-f271be2444d2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:42.947190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4610f-d169-4c65-acb7-f271be2444d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:42.965139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-59d4610f-d169-4c65-acb7-f271be2444d2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:42.966337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-59d4610f-d169-4c65-acb7-f271be2444d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:42.974475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:43.127820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103db4-91c8-45db-bcaf-3f25904dc3b0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:43.142978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e103db4-91c8-45db-bcaf-3f25904dc3b0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:43.149109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:43.149747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:43.150032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:43.150306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:43.158667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:43.160245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74172e4a-4a1d-4ed1-a7db-d69fd9314c88 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:43.170243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 719/1432] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:44.455844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8695-b81e-4d70-8713-fef761cc6321 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:44.456407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8695-b81e-4d70-8713-fef761cc6321 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:44.456407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a8695-b81e-4d70-8713-fef761cc6321 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:44.458431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:44.463365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba79b2-4ecc-46d0-ad06-dc22d1c1e565 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:44.463795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba79b2-4ecc-46d0-ad06-dc22d1c1e565 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:44.463947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba79b2-4ecc-46d0-ad06-dc22d1c1e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:44.481789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-49ba79b2-4ecc-46d0-ad06-dc22d1c1e565 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:44.482964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-49ba79b2-4ecc-46d0-ad06-dc22d1c1e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:44.491608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:44.642859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a8695-b81e-4d70-8713-fef761cc6321 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:44.657511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a8695-b81e-4d70-8713-fef761cc6321 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:44.663358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09534680-4656-4360-9cee-1f8130977705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:44.663999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534680-4656-4360-9cee-1f8130977705 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:44.664280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534680-4656-4360-9cee-1f8130977705 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:44.664551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09534680-4656-4360-9cee-1f8130977705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:44.673133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09534680-4656-4360-9cee-1f8130977705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:44.674734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09534680-4656-4360-9cee-1f8130977705 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:44.684815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 715/1435] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:45.980131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d7afc-2bfa-49d0-ad36-83ac43aad3c9 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:45.980660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d7afc-2bfa-49d0-ad36-83ac43aad3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:45.980660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d7afc-2bfa-49d0-ad36-83ac43aad3c9 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:45.982386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:45.987444 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774079ed-4865-4b28-be88-d3686223be01 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:45.987890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774079ed-4865-4b28-be88-d3686223be01 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:45.988009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774079ed-4865-4b28-be88-d3686223be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:46.007722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-774079ed-4865-4b28-be88-d3686223be01 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:46.008918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-774079ed-4865-4b28-be88-d3686223be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:46.016608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:46.170887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d7afc-2bfa-49d0-ad36-83ac43aad3c9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:46.187027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d7afc-2bfa-49d0-ad36-83ac43aad3c9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:46.193604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:46.194243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:46.194524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:46.194797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:46.203136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:46.204711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf8c3f0-a752-4a94-aaa4-b0abb986ef19 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:46.214985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 722/1438] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:47.499506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39604a-e6f7-4d49-beea-041611f4ad53 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:47.500109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39604a-e6f7-4d49-beea-041611f4ad53 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:47.500109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39604a-e6f7-4d49-beea-041611f4ad53 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:47.501861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:47.507660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0464-a16b-488d-9b0a-78155516b27d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:47.508238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0464-a16b-488d-9b0a-78155516b27d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:47.508238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0464-a16b-488d-9b0a-78155516b27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:47.526915 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-662f0464-a16b-488d-9b0a-78155516b27d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:47.528125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-662f0464-a16b-488d-9b0a-78155516b27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:47.537638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:47.690056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39604a-e6f7-4d49-beea-041611f4ad53 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:47.704795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39604a-e6f7-4d49-beea-041611f4ad53 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:47.710817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:47.711456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:47.711736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:47.712011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:47.720714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:47.722420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36878-2251-44ac-89b7-b47ca32b54b3 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:47.732642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 718/1441] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:49.870815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967221-b41a-4f55-9c7b-170d5c396198 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:49.871380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967221-b41a-4f55-9c7b-170d5c396198 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:49.871380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7967221-b41a-4f55-9c7b-170d5c396198 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:49.873189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:49.879026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056a9a-dd63-47cb-af2e-0acccb506edd None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:49.879552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056a9a-dd63-47cb-af2e-0acccb506edd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:49.879658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056a9a-dd63-47cb-af2e-0acccb506edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:49.897262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9a056a9a-dd63-47cb-af2e-0acccb506edd None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:49.898479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9a056a9a-dd63-47cb-af2e-0acccb506edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:49.909994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:49.949349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967221-b41a-4f55-9c7b-170d5c396198 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:49.960234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7967221-b41a-4f55-9c7b-170d5c396198 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:49.963719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:49.964347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:49.964622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:49.964889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:49.974358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:49.975832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3059144d-c857-40bf-b6e2-09aaa0333918 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:49.985289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 725/1444] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:52.405412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e15-0c87-4ead-a31b-f3ee75465e52 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:52.405994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e15-0c87-4ead-a31b-f3ee75465e52 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:52.405994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e15-0c87-4ead-a31b-f3ee75465e52 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:52.407726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:52.413215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c44cc-dc73-4ee6-a5af-fd190ad6fdd0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:52.413690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c44cc-dc73-4ee6-a5af-fd190ad6fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:52.413818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c44cc-dc73-4ee6-a5af-fd190ad6fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:52.433121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7c6c44cc-dc73-4ee6-a5af-fd190ad6fdd0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:52.434300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7c6c44cc-dc73-4ee6-a5af-fd190ad6fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:52.443315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:13:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:13:52.481206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7e15-0c87-4ead-a31b-f3ee75465e52 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:52.495684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7e15-0c87-4ead-a31b-f3ee75465e52 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:52.499726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:52.500543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:52.500823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:52.501129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:52.512783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:52.514294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707e642-fd06-482a-abd2-f18784f2b8e1 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:52.525396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 721/1447] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:55.113313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ca49-8bd5-48fc-857f-24be87570b92 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:55.113950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ca49-8bd5-48fc-857f-24be87570b92 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:55.113950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0ca49-8bd5-48fc-857f-24be87570b92 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:55.116486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:55.122066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dfb2-5be1-4918-ab84-03424d075141 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:55.122546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dfb2-5be1-4918-ab84-03424d075141 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:55.122640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40dfb2-5be1-4918-ab84-03424d075141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:55.141302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6a40dfb2-5be1-4918-ab84-03424d075141 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:55.142511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6a40dfb2-5be1-4918-ab84-03424d075141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:55.150661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:55.190546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ca49-8bd5-48fc-857f-24be87570b92 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:55.201753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0ca49-8bd5-48fc-857f-24be87570b92 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:55.205479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:55.206142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:55.206425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:55.206703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:55.216124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:55.217592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a2557-9835-4b38-85a9-57a7b1920a87 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:55.227698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 728/1450] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:13:57.673274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04b9c-437e-4474-885f-c488023ea778 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:57.673875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04b9c-437e-4474-885f-c488023ea778 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:57.673875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d04b9c-437e-4474-885f-c488023ea778 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:57.675628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:13:57.681982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059c04-1800-44a6-9692-42f334a54db0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:57.682560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059c04-1800-44a6-9692-42f334a54db0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:57.682560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c059c04-1800-44a6-9692-42f334a54db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:57.701078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1c059c04-1800-44a6-9692-42f334a54db0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:13:57.702273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1c059c04-1800-44a6-9692-42f334a54db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:13:57.710805 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:13:57.750713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d04b9c-437e-4474-885f-c488023ea778 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:13:57.762726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d04b9c-437e-4474-885f-c488023ea778 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:13:57.766317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:13:57.766997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:13:57.767283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:13:57.767556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:13:57.777138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:13:57.778578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf2c5d-ead7-4985-a640-b60f907d50f4 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:13:57.788489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 724/1453] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:00.129206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da74-ba5a-48c2-b953-75ad54181863 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:00.129733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da74-ba5a-48c2-b953-75ad54181863 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:00.129733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59da74-ba5a-48c2-b953-75ad54181863 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:00.131903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:00.137844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3faa-5fef-4809-95c5-fbfbb6b217f0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:00.138498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3faa-5fef-4809-95c5-fbfbb6b217f0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:00.138498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3faa-5fef-4809-95c5-fbfbb6b217f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:00.157526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9ebc3faa-5fef-4809-95c5-fbfbb6b217f0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:00.158729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9ebc3faa-5fef-4809-95c5-fbfbb6b217f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:00.169663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:00.207263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59da74-ba5a-48c2-b953-75ad54181863 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:00.218823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59da74-ba5a-48c2-b953-75ad54181863 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:00.222391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:00.224858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:00.224858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:00.224858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:00.233970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:00.235400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e31f61-8c75-4337-a565-f32dc9e7bc63 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:00.247522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 731/1456] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:02.592566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c356ad-6a71-4773-b38c-5583102d52a4 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:02.592566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c356ad-6a71-4773-b38c-5583102d52a4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:02.592566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c356ad-6a71-4773-b38c-5583102d52a4 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:02.596020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:14:02.600345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db95e3-bb10-4dbc-8a62-54356f9138e1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:02.600880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db95e3-bb10-4dbc-8a62-54356f9138e1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:02.601004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db95e3-bb10-4dbc-8a62-54356f9138e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:02.619632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-45db95e3-bb10-4dbc-8a62-54356f9138e1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:02.620826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-45db95e3-bb10-4dbc-8a62-54356f9138e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:02.628987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:02.670914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c356ad-6a71-4773-b38c-5583102d52a4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:02.682560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c356ad-6a71-4773-b38c-5583102d52a4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:02.686391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:02.687038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:02.687320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:02.687596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:02.697017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:02.698659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af117c-8c05-413b-aebf-84aaa361cfad service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:02.709475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 727/1459] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:05.049971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b84e1-7478-4caa-9ead-98dad166189b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:05.050523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b84e1-7478-4caa-9ead-98dad166189b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:05.050523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b84e1-7478-4caa-9ead-98dad166189b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:05.052372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:05.058633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee1b8-d75f-434d-a41a-1f6eb8cd9ee0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:05.059178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee1b8-d75f-434d-a41a-1f6eb8cd9ee0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:05.059178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eee1b8-d75f-434d-a41a-1f6eb8cd9ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:05.078084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-83eee1b8-d75f-434d-a41a-1f6eb8cd9ee0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:05.079287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-83eee1b8-d75f-434d-a41a-1f6eb8cd9ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:05.088051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:05.125001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b84e1-7478-4caa-9ead-98dad166189b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:05.136660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b84e1-7478-4caa-9ead-98dad166189b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:05.140223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:05.140860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:05.141181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:05.141457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:05.152691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:05.154174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34aa47a-4f97-4b38-a3cd-205531f911dc service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:05.164131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 734/1462] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:07.608546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437dc9-4b32-4339-9be0-f20277ceebe3 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:07.609183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437dc9-4b32-4339-9be0-f20277ceebe3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:07.609183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e437dc9-4b32-4339-9be0-f20277ceebe3 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:07.610916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:07.616807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb0e0-2846-4b6a-b6b1-ca5b0c8877cb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:07.617348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb0e0-2846-4b6a-b6b1-ca5b0c8877cb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:07.617463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbb0e0-2846-4b6a-b6b1-ca5b0c8877cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:07.637273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-76bbb0e0-2846-4b6a-b6b1-ca5b0c8877cb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:07.638507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-76bbb0e0-2846-4b6a-b6b1-ca5b0c8877cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:07.647274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:07.687140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e437dc9-4b32-4339-9be0-f20277ceebe3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:07.698581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e437dc9-4b32-4339-9be0-f20277ceebe3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:07.702381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:07.703056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:07.703340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:07.703621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:07.714248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:07.715707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dfaba4-ee6b-435d-8a60-f138b989fb88 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:07.727284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 730/1465] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:10.004965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b4f3-9c09-48ce-a3b4-50e3b1e5a006 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:10.005585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b4f3-9c09-48ce-a3b4-50e3b1e5a006 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:10.005585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193b4f3-9c09-48ce-a3b4-50e3b1e5a006 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:10.007491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:10.013632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82894c4a-225d-40a4-a029-1ab0502b18cc None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:10.014332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82894c4a-225d-40a4-a029-1ab0502b18cc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:10.014332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82894c4a-225d-40a4-a029-1ab0502b18cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:10.033284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-82894c4a-225d-40a4-a029-1ab0502b18cc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:10.034513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-82894c4a-225d-40a4-a029-1ab0502b18cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:10.043177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:14:10.082106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b4f3-9c09-48ce-a3b4-50e3b1e5a006 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:10.093258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193b4f3-9c09-48ce-a3b4-50e3b1e5a006 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:10.096919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:10.097588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:10.098427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:10.098709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:10.108616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:10.110078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6cc7e-010c-4d18-8a50-44b3ffb0d959 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:10.121201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 737/1468] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:14:12.398352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71db5f-8260-4a3a-a50e-ebed6a995f3d None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:12.398943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71db5f-8260-4a3a-a50e-ebed6a995f3d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:12.398943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71db5f-8260-4a3a-a50e-ebed6a995f3d None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:12.400791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:12.406980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf790-26c8-4a97-88e1-e876c347f694 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:12.407536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf790-26c8-4a97-88e1-e876c347f694 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:12.407536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbf790-26c8-4a97-88e1-e876c347f694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:12.428258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9ddbf790-26c8-4a97-88e1-e876c347f694 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:12.429504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9ddbf790-26c8-4a97-88e1-e876c347f694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:12.437556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:12.475836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71db5f-8260-4a3a-a50e-ebed6a995f3d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:12.487041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71db5f-8260-4a3a-a50e-ebed6a995f3d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:12.491394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:12.492056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:12.492341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:12.492619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:12.502425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:12.504416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b284-90ba-46c6-b9e2-067e5a3410f1 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:12.515433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 733/1471] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:29.251583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab57e-7d70-4af1-a47b-9b1bfc442294 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:29.252170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab57e-7d70-4af1-a47b-9b1bfc442294 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:29.252170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab57e-7d70-4af1-a47b-9b1bfc442294 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:29.254825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 739/1472] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:29.260322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8253de-78ed-4a97-9b87-e48af0111490 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:29.260772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8253de-78ed-4a97-9b87-e48af0111490 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:29.260875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8253de-78ed-4a97-9b87-e48af0111490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:29.278508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1f8253de-78ed-4a97-9b87-e48af0111490 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:29.279706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1f8253de-78ed-4a97-9b87-e48af0111490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:29.287731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 734/1473] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:29.334591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359571d1-ddd2-43ea-9a49-f3512087636b None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:29.334875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359571d1-ddd2-43ea-9a49-f3512087636b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:29.335147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359571d1-ddd2-43ea-9a49-f3512087636b None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:29.336890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 740/1474] 10.222.0.45 () {54 vars in 962 bytes} [Tue Feb 15 04:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:29.341771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25bc-84d6-4aaf-85ed-b5c09743a147 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:29.342065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25bc-84d6-4aaf-85ed-b5c09743a147 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:29.342344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d25bc-84d6-4aaf-85ed-b5c09743a147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:29.360186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-4d4d25bc-84d6-4aaf-85ed-b5c09743a147 None None] MFA Rules not processed for user `7a77604b8ff64cf883d700d2563ab131`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:29.361404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4d4d25bc-84d6-4aaf-85ed-b5c09743a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:29.368349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 735/1475] 10.222.0.45 () {58 vars in 1059 bytes} [Tue Feb 15 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:29.375678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359571d1-ddd2-43ea-9a49-f3512087636b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:29.387094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359571d1-ddd2-43ea-9a49-f3512087636b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:29.390952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:29.391599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:29.391880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:29.392188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:29.401195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:29.402639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7df04-de8b-4495-91f4-b4479c9df260 service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:29.411855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 741/1476] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:31.763178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae92c1-010d-4175-a83f-93ecc3a91b8d None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:31.763772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae92c1-010d-4175-a83f-93ecc3a91b8d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:31.763772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae92c1-010d-4175-a83f-93ecc3a91b8d None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:31.765648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 736/1477] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:31.771769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef797a3-b5d8-4533-afd0-951aa63ede55 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:31.772225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef797a3-b5d8-4533-afd0-951aa63ede55 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:31.772351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef797a3-b5d8-4533-afd0-951aa63ede55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:31.790603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-eef797a3-b5d8-4533-afd0-951aa63ede55 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:31.791830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eef797a3-b5d8-4533-afd0-951aa63ede55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:31.800858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 742/1478] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:31.825201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae92c1-010d-4175-a83f-93ecc3a91b8d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:31.838328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae92c1-010d-4175-a83f-93ecc3a91b8d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:31.842791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:31.843441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:31.843723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:31.843997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:31.844732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:31.846647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a9742-6136-40bc-8117-9e1fc316acba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:31.860351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 737/1479] 10.222.0.45 () {56 vars in 1108 bytes} [Tue Feb 15 04:14:31 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:14:34.166182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af92f-6510-4718-b526-a9d2b30ce7da None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:34.166698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af92f-6510-4718-b526-a9d2b30ce7da None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:34.166698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3af92f-6510-4718-b526-a9d2b30ce7da None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:34.168478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 743/1480] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:34.174081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1a67-6c7e-4af4-8ef7-7d6eb3ffb8eb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:34.174578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1a67-6c7e-4af4-8ef7-7d6eb3ffb8eb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:34.174686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be1a67-6c7e-4af4-8ef7-7d6eb3ffb8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:34.192825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d1be1a67-6c7e-4af4-8ef7-7d6eb3ffb8eb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:34.194055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d1be1a67-6c7e-4af4-8ef7-7d6eb3ffb8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:34.201887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 738/1481] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:34.244975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af92f-6510-4718-b526-a9d2b30ce7da None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:34.259721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3af92f-6510-4718-b526-a9d2b30ce7da None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:34.265158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:34.265794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:34.266076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:34.266352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:34.276593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:34.278250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0a6d0-f471-4f63-8ead-4d48b17b3300 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:34.289124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 744/1482] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:36.750850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8fef-dac5-4ca9-afb2-d0228b1435e4 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:36.751584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8fef-dac5-4ca9-afb2-d0228b1435e4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:36.751584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8fef-dac5-4ca9-afb2-d0228b1435e4 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:36.753488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 739/1483] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:36.759748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86eab-f636-49c5-8060-30ba54a882f5 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:36.760241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86eab-f636-49c5-8060-30ba54a882f5 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:36.760346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad86eab-f636-49c5-8060-30ba54a882f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:36.778077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-2ad86eab-f636-49c5-8060-30ba54a882f5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:36.779273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2ad86eab-f636-49c5-8060-30ba54a882f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:36.787263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 745/1484] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:36.824229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8fef-dac5-4ca9-afb2-d0228b1435e4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:36.834858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8fef-dac5-4ca9-afb2-d0228b1435e4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:36.838371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:36.839005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:36.839291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:36.839558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:36.848625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:36.850097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7e85b-4fe4-4ae1-82b7-f0837f032291 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:36.859563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 740/1485] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:39.184194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d4fe-5b8f-4e63-91a9-2c4ba7eda2a2 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:39.184763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d4fe-5b8f-4e63-91a9-2c4ba7eda2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:39.184763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d4fe-5b8f-4e63-91a9-2c4ba7eda2a2 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:39.186539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 746/1486] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:39.192006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54cb6-334f-4908-a781-3e6910de2359 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:39.192452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54cb6-334f-4908-a781-3e6910de2359 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:39.192556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed54cb6-334f-4908-a781-3e6910de2359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:39.210613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-eed54cb6-334f-4908-a781-3e6910de2359 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:39.211807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-eed54cb6-334f-4908-a781-3e6910de2359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:39.219655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 741/1487] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:39.258591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d4fe-5b8f-4e63-91a9-2c4ba7eda2a2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:39.269851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d4fe-5b8f-4e63-91a9-2c4ba7eda2a2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:39.273397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:39.274026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:39.274303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:39.274573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:39.283595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:39.285106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325517-39ba-4517-aff2-cc590950e183 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:39.294581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 747/1488] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:41.741728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fb10-224a-4217-9922-e88950f98d79 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:41.742270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fb10-224a-4217-9922-e88950f98d79 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:41.742270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3fb10-224a-4217-9922-e88950f98d79 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:41.744045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 742/1489] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:41.753265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6116bf-eba1-44ce-9bbc-721668e0362b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:41.754298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6116bf-eba1-44ce-9bbc-721668e0362b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:41.754416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6116bf-eba1-44ce-9bbc-721668e0362b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:41.773135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4d6116bf-eba1-44ce-9bbc-721668e0362b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:41.774324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4d6116bf-eba1-44ce-9bbc-721668e0362b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:41.782102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 748/1490] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:41.823930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3fb10-224a-4217-9922-e88950f98d79 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:41.835022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3fb10-224a-4217-9922-e88950f98d79 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:41.838573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:41.839216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:41.839497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:41.839767 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:41.848841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:41.850294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb5615-5678-4a5b-aced-3a53dd496c0d service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:41.859553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 743/1491] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:14:44.371007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809feb-87ec-45c4-a993-dc5b38ccc023 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:44.371625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809feb-87ec-45c4-a993-dc5b38ccc023 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:44.371625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14809feb-87ec-45c4-a993-dc5b38ccc023 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:44.373354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 749/1492] 10.222.0.45 () {54 vars in 926 bytes} [Tue Feb 15 04:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:14:44.379288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c4b1-fd6b-4de8-a169-b89773c9b975 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:44.379736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c4b1-fd6b-4de8-a169-b89773c9b975 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:44.380017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88c4b1-fd6b-4de8-a169-b89773c9b975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:44.399417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ea88c4b1-fd6b-4de8-a169-b89773c9b975 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:14:44.400626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ea88c4b1-fd6b-4de8-a169-b89773c9b975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:14:44.408465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 744/1493] 10.222.0.45 () {58 vars in 1023 bytes} [Tue Feb 15 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:14:44.448028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809feb-87ec-45c4-a993-dc5b38ccc023 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:14:44.459316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14809feb-87ec-45c4-a993-dc5b38ccc023 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:14:44.462879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:14:44.463510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:14:44.463790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:14:44.464064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:14:44.473695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:14:44.475121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89aca6a-18c6-43bf-a06f-6078b9707339 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:14:44.484483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 750/1494] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:16:04.537866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.538474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.538474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.555976 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:16:04.557193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:04.565372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 745/1495] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:16:04.574684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.575217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.575217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.594038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:16:04.595227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:04.603753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 751/1496] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:16:04.608524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.618439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49757f3-0442-4a09-b67f-6bb8d4004cf7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.623056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.623708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.623991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.624264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.625027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:16:04.625334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.626929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.638905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 746/1497] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:16:04.647939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.657542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba844f6-9324-46d2-9c4a-deaba4fcd4bf None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.663225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.663938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.664260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.664572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.665437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.667527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.706205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 752/1498] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:16:04 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:16:04.710574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.720551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead2581-37df-4106-8c14-0e9a3c0f7c69 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.780218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.780916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.781210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.781488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.782201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.784204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.804579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 747/1499] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:16:04 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:16:04.808790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.820144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967a4a-59c0-479b-9b1e-5c30afa5ba1a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.824666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.825350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.825633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.825909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.826645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.828237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.841724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 753/1500] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:16:04.845730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.855728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142895e1-8aa9-4a86-a2ce-cac36a2b4e71 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.860322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.861015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.861300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.861575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.862390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.863987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12483a-3936-4576-9f23-c7df82d9f948 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.878389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 748/1501] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:16:04.882897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:04.892572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284264ce-c70d-4af2-be23-c5a247f06e6f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:04.897745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:04.898599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.898881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.899154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] PATH_INFO: `/v3/projects/985650e8c524449bbf8b3e6c351fb147/users/44b88930f49f44f1823b1260fbb3ce8e/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.914633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] RBAC: Authorizing `identity:create_grant(project_id=985650e8c524449bbf8b3e6c351fb147, user_id=44b88930f49f44f1823b1260fbb3ce8e, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:04.917438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:04.931270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 754/1502] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:16:04 2022] PUT /identity/v3/projects/985650e8c524449bbf8b3e6c351fb147/users/44b88930f49f44f1823b1260fbb3ce8e/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:16:04.944375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9613-f736-490d-a6ce-edb5f594ddc7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:04.944716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9613-f736-490d-a6ce-edb5f594ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:04.945085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e9613-f736-490d-a6ce-edb5f594ddc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:04.973479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-189e9613-f736-490d-a6ce-edb5f594ddc7 None None] MFA Rules not processed for user `44b88930f49f44f1823b1260fbb3ce8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:16:04.974687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-189e9613-f736-490d-a6ce-edb5f594ddc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:05.039860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 749/1503] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:16:05.050843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:05.123895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c35c90-68f5-487d-afbe-4da29926540f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:05.130517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:05.131158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.131439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.131715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.139834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:05.141446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:05.150694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 755/1504] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:16:05.226678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a5817-acfd-4cd3-9b89-f63791e934de None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.227120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a5817-acfd-4cd3-9b89-f63791e934de None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.227584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a5817-acfd-4cd3-9b89-f63791e934de None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.229340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 750/1505] 10.222.0.45 () {52 vars in 829 bytes} [Tue Feb 15 04:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:16:05.233251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:05.302832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cccf02e-311e-4b75-af05-d7a7d0820eb9 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:05.307641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:05.308511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.308798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.309103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] PATH_INFO: `/v3/users/44b88930f49f44f1823b1260fbb3ce8e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.310371 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b88930f49f44f1823b1260fbb3ce8e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:05.311533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:16:05.311533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:16:05.311533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:16:05.312764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:05.382919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b88930f49f44f1823b1260fbb3ce8e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:05.400772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b88930f49f44f1823b1260fbb3ce8e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:05.401526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b88930f49f44f1823b1260fbb3ce8e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:05.415927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b88930f49f44f1823b1260fbb3ce8e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:05.426595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b88930f49f44f1823b1260fbb3ce8e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:05.432945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 756/1506] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:16:05 2022] DELETE /identity/v3/users/44b88930f49f44f1823b1260fbb3ce8e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:16:05.437391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.437675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.437960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.456540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:16:05.457785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:05.516109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 751/1507] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:16:05.526075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:05.527520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:05.588314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f07b9-2ee5-4a93-964f-849e7bf04848 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:05.592204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:05.592858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.593171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.593449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.604259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:05.605865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134752e-1f58-4020-a614-c37df6cce309 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:05.617236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 757/1508] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:16:05.973040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:16:05.975361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:16:05.988505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5aaa6-3358-4a94-a5e9-31ed71ea83e4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:16:05.993648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:16:05.994604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:16:05.994958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:16:05.995315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] PATH_INFO: `/v3/projects/985650e8c524449bbf8b3e6c351fb147` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:16:05.996607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985650e8c524449bbf8b3e6c351fb147)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:16:05.997674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:16:05.997674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:16:05.997674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:16:05.998924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:16:06.072863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985650e8c524449bbf8b3e6c351fb147', 'request_id': 'req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:06.078683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985650e8c524449bbf8b3e6c351fb147', 'request_id': 'req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:06.090251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985650e8c524449bbf8b3e6c351fb147', 'request_id': 'req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:06.109580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] The token cache is being invalidate because project 985650e8c524449bbf8b3e6c351fb147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:16:06.109870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:06.110658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a2fc1952-8a7d-4e0f-91c0-753b6c971fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:16:06.113214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 752/1509] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:16:05 2022] DELETE /identity/v3/projects/985650e8c524449bbf8b3e6c351fb147 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:17:36.891667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:36.892237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:36.892237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:36.894678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 758/1510] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:36.899435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a6d-7ae5-47b6-93aa-02b11e24a392 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:36.899871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a6d-7ae5-47b6-93aa-02b11e24a392 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:36.899978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45a6d-7ae5-47b6-93aa-02b11e24a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:36.919913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-add45a6d-7ae5-47b6-93aa-02b11e24a392 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:36.921158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-add45a6d-7ae5-47b6-93aa-02b11e24a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:36.977825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 753/1511] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:37.141388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:37.143202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:37.215696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc8353-9bac-4268-9989-a745c95d1ff4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:37.221121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:37.222273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:37.222559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:37.222831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:37.231131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:37.233042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37abc37-db7e-4102-8acb-95d0e754ba33 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:37.242697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 759/1512] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:17:37.359750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee17e0-fc04-41dc-b355-99a4a0856118 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:37.360176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee17e0-fc04-41dc-b355-99a4a0856118 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:37.360465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee17e0-fc04-41dc-b355-99a4a0856118 None None] PATH_INFO: `/v3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:37.362582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 754/1513] 10.222.0.59 () {54 vars in 925 bytes} [Tue Feb 15 04:17:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:17:37.368551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285ea5-a5aa-4ed3-823c-9d615f63d524 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:37.368841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285ea5-a5aa-4ed3-823c-9d615f63d524 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:37.369147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285ea5-a5aa-4ed3-823c-9d615f63d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:37.388259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ed285ea5-a5aa-4ed3-823c-9d615f63d524 None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:37.389577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ed285ea5-a5aa-4ed3-823c-9d615f63d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:37.451660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 760/1514] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Feb 15 04:17:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:38.558587 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90dcb-0836-4567-80bd-a3c67b71fbb2 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:38.559183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90dcb-0836-4567-80bd-a3c67b71fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:38.559183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90dcb-0836-4567-80bd-a3c67b71fbb2 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:38.560919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 755/1515] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:38.565985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378216-a2ad-4785-b22f-0c3f7946bd66 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:38.566421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378216-a2ad-4785-b22f-0c3f7946bd66 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:38.566534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d378216-a2ad-4785-b22f-0c3f7946bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:38.584089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9d378216-a2ad-4785-b22f-0c3f7946bd66 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:38.585310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9d378216-a2ad-4785-b22f-0c3f7946bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:38.593158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 761/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:38.755410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90dcb-0836-4567-80bd-a3c67b71fbb2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:38.769813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90dcb-0836-4567-80bd-a3c67b71fbb2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:38.775113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:38.775754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:38.776042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:38.776321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:38.785476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:38.787089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6747fb-fb91-4da8-bb8a-2ff051298b64 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:38.796327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 756/1517] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:17:41.348709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8cc9-5801-4565-889d-668a77daa071 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:41.349338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8cc9-5801-4565-889d-668a77daa071 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:41.349338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb8cc9-5801-4565-889d-668a77daa071 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:41.350967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 762/1518] 10.222.0.45 () {54 vars in 960 bytes} [Tue Feb 15 04:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:41.356393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2d38-bb09-4493-a709-3714cbed96ba None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:41.356926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2d38-bb09-4493-a709-3714cbed96ba None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:41.357149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef2d38-bb09-4493-a709-3714cbed96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:41.376431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c9ef2d38-bb09-4493-a709-3714cbed96ba None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:41.378529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c9ef2d38-bb09-4493-a709-3714cbed96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:41.387951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 757/1519] 10.222.0.45 () {58 vars in 1057 bytes} [Tue Feb 15 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:41.396344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8cc9-5801-4565-889d-668a77daa071 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:41.410633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb8cc9-5801-4565-889d-668a77daa071 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:41.415640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:41.416276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:41.416561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:41.416841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:41.426025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:41.427622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691dd55-0fe9-4946-a0d3-dfacb4e43726 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:41.437345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 763/1520] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:17:50.537887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8a857-31c6-4b3b-8062-743db2772dc9 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:50.538536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8a857-31c6-4b3b-8062-743db2772dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:50.538536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8a857-31c6-4b3b-8062-743db2772dc9 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:50.540216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 758/1521] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:50.545303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059fddf-587c-4a7f-ae39-8623190acfdb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:50.545760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059fddf-587c-4a7f-ae39-8623190acfdb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:50.545962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059fddf-587c-4a7f-ae39-8623190acfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:50.564601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c059fddf-587c-4a7f-ae39-8623190acfdb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:50.566466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c059fddf-587c-4a7f-ae39-8623190acfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:50.574528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 764/1522] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:50.727957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8a857-31c6-4b3b-8062-743db2772dc9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:50.741907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8a857-31c6-4b3b-8062-743db2772dc9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:50.747268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:50.747907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:50.748190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:50.748469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:50.758407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:50.760028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939afde6-0f24-46f9-9da3-7953173e407b service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:50.769897 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 759/1523] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:17:52.050733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ab99-d038-4733-bc46-0bf0de3fceb1 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:52.051283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ab99-d038-4733-bc46-0bf0de3fceb1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:52.051283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304ab99-d038-4733-bc46-0bf0de3fceb1 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:52.053003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Feb 15 04:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:52.057906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce23a-13e7-4b37-9483-fd0b1ccd6dc9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:52.058355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce23a-13e7-4b37-9483-fd0b1ccd6dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:52.058355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce23a-13e7-4b37-9483-fd0b1ccd6dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:52.077110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-034ce23a-13e7-4b37-9483-fd0b1ccd6dc9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:52.078299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-034ce23a-13e7-4b37-9483-fd0b1ccd6dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:52.086812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Feb 15 04:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:52.238382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304ab99-d038-4733-bc46-0bf0de3fceb1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:52.252702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304ab99-d038-4733-bc46-0bf0de3fceb1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:52.259061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:52.259694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:52.259978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:52.260255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:52.269746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:52.271427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf73d4d-d405-4597-9020-10d2ba47823d service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:52.280950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 766/1526] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:17:56.700748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:56.701333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:56.701333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:56.703118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 761/1527] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:56.709271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a3e72-2c2c-40d2-80f5-64c10ad78bcc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:56.710051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a3e72-2c2c-40d2-80f5-64c10ad78bcc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:56.710231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a3e72-2c2c-40d2-80f5-64c10ad78bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:56.728846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c62a3e72-2c2c-40d2-80f5-64c10ad78bcc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:56.730058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c62a3e72-2c2c-40d2-80f5-64c10ad78bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:56.738498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 767/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:56.775806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:56.777538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:56.833731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c734af-0c67-438d-9148-eb6c6e83b2dc None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:56.837327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:56.837969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:56.838255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:56.838531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:56.847583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:56.849040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6379765-994c-4e08-b076-2ea3cb8639d7 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:56.858219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 762/1529] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:17:59.113470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd083b-26cf-4afa-a034-7af1029afe54 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:59.114053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd083b-26cf-4afa-a034-7af1029afe54 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:59.114053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd083b-26cf-4afa-a034-7af1029afe54 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:59.115797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 768/1530] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:17:59.121211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d36a-83c7-4157-8094-1ceea47a7f27 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:59.121643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d36a-83c7-4157-8094-1ceea47a7f27 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:59.121846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8d36a-83c7-4157-8094-1ceea47a7f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:59.140488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cdc8d36a-83c7-4157-8094-1ceea47a7f27 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:17:59.141716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cdc8d36a-83c7-4157-8094-1ceea47a7f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:17:59.149624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 763/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:17:59.186866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd083b-26cf-4afa-a034-7af1029afe54 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:17:59.198607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd083b-26cf-4afa-a034-7af1029afe54 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:17:59.202153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:17:59.202779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:17:59.203057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:17:59.203329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:17:59.213149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:17:59.214637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653efc9-188a-4ce0-aa61-8f6667c3851c service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:17:59.224701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 769/1532] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:18:03.185200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:03.185829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:03.185829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:03.187705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 764/1533] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:18:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:18:03.193048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9f4-5292-4608-b028-3f55f39f7452 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:03.193720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9f4-5292-4608-b028-3f55f39f7452 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:03.193720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6a9f4-5292-4608-b028-3f55f39f7452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:03.211919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ead6a9f4-5292-4608-b028-3f55f39f7452 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:18:03.213116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ead6a9f4-5292-4608-b028-3f55f39f7452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:18:03.221190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 770/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:18:03.478308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:18:03.479896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:18:03.537231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a5d0-5296-4545-b1bc-9c4f02edb31b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:18:03.540820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:18:03.541499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:03.541778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:03.542055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:03.550968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:18:03.552403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbcbf05-04ef-482d-8a83-68d726fae271 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:18:03.561632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 765/1535] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:18:05.889158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63621-e5a2-4779-b1cd-a1ece9eeb8bb None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:05.889732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63621-e5a2-4779-b1cd-a1ece9eeb8bb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:05.889732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa63621-e5a2-4779-b1cd-a1ece9eeb8bb None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:05.891516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 771/1536] 127.0.0.1 () {54 vars in 916 bytes} [Tue Feb 15 04:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:18:05.897172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc369e-3813-4d67-ba68-ed046c4fec92 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:05.897604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc369e-3813-4d67-ba68-ed046c4fec92 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:05.897710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc369e-3813-4d67-ba68-ed046c4fec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:05.915583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-54dc369e-3813-4d67-ba68-ed046c4fec92 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:18:05.916773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-54dc369e-3813-4d67-ba68-ed046c4fec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:18:05.925178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 766/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Feb 15 04:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:18:06.179178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9681fd-58f0-4f03-a83b-77f8e593b544 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:06.179467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9681fd-58f0-4f03-a83b-77f8e593b544 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:06.179749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9681fd-58f0-4f03-a83b-77f8e593b544 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:06.181626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 772/1538] 10.222.0.45 () {54 vars in 963 bytes} [Tue Feb 15 04:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:18:06.186837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eece4-feff-499f-8d4c-18b678312a84 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:06.187130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eece4-feff-499f-8d4c-18b678312a84 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:06.187411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eece4-feff-499f-8d4c-18b678312a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:06.205163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b63eece4-feff-499f-8d4c-18b678312a84 None None] MFA Rules not processed for user `920aa75581fb41b0b6b09e07399a01b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:18:06.206503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b63eece4-feff-499f-8d4c-18b678312a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:18:06.212972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 767/1539] 10.222.0.45 () {58 vars in 1060 bytes} [Tue Feb 15 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:18:06.220689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9681fd-58f0-4f03-a83b-77f8e593b544 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:18:06.232100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9681fd-58f0-4f03-a83b-77f8e593b544 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:18:06.235727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:18:06.236363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:18:06.236646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:18:06.237535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:18:06.246786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:18:06.248229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13dad0-e540-4e0e-a9d1-467d4a05236a service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:18:06.257928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 773/1540] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:32.742828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:32.743456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:32.743456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:32.770103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:32.771305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:32.784419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 768/1541] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:32.794404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:32.794981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:32.794981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:32.817057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:32.818921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:32.833487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 774/1542] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:32.838329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:32.853700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04e173-ba12-4b1b-a051-106a1bddcaf2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:32.862492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:32.863217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:32.863507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:32.863841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:32.864524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:32.864838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:32.866502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:32.882657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 769/1543] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:32.897717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:32.912053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cc93e-9feb-4356-842b-c90346a429ed None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:32.920829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:32.921526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:32.921811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:32.922090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:32.922806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:32.924787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd366a-5883-4345-b2ae-f8e7ebe690ec admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:32.967828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 775/1544] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:32 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:32.971983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:32.985782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ce867-a2f1-448e-9cf9-73a794103673 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.012146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5baef-26f9-48bf-b387-80cbe277fb3c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.012476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5baef-26f9-48bf-b387-80cbe277fb3c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.012748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5baef-26f9-48bf-b387-80cbe277fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.057961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-62b5baef-26f9-48bf-b387-80cbe277fb3c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.059184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-62b5baef-26f9-48bf-b387-80cbe277fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.069184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.069869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.070728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.071013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.071722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.074085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.120608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 770/1545] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:32 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:33.127577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.139158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef1b7c-6d07-4749-99dc-106c01031654 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.148299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.149027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.149317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.149596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.150348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.152796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.169529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 771/1546] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:33.173878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.185984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1578d1a-8569-4fc0-b10c-5367002d2888 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.195864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.196727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.197048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.197386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.198149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.199801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63946c42-23f9-4ca4-b18a-2a9fa371fa06 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.201924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 776/1547] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.203933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.204254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.204541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.216944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 772/1548] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:33.223050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.223289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.223522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.247757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.249253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.250695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.253259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.262954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 773/1549] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.263766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.280289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924f50d-3d12-4233-a4cd-a326b1a3c0a9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.290885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.291797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.292082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.292358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] PATH_INFO: `/v3/projects/3d7002e2df35463c9128baa00359cd9e/users/a2f544b022f84fb291d0794dca05788d/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.306528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 777/1550] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.307187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.314084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7002e2df35463c9128baa00359cd9e, user_id=a2f544b022f84fb291d0794dca05788d, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.317446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524d62e-53d3-4b40-82a1-2ab3f7e43c2a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.327855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd4fd-f55b-45a2-8b2f-755dfed38e61 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.347775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 774/1551] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:33 2022] PUT /identity/v3/projects/3d7002e2df35463c9128baa00359cd9e/users/a2f544b022f84fb291d0794dca05788d/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:33.349121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.349801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.350090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.350372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.351145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:33.351280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a3d4-bbbb-4129-8188-6bcc9410ccfa None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.351472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a3d4-bbbb-4129-8188-6bcc9410ccfa None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.351578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.351731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870a3d4-bbbb-4129-8188-6bcc9410ccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.353149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdfe7b-7fcc-4892-ad6a-6890179f4c3a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.379615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 778/1552] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:33.380462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9870a3d4-bbbb-4129-8188-6bcc9410ccfa None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.381052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087b2a-494c-4c6e-b4fd-4e0ff082a9d3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.381348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087b2a-494c-4c6e-b4fd-4e0ff082a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.381637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087b2a-494c-4c6e-b4fd-4e0ff082a9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.381901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9870a3d4-bbbb-4129-8188-6bcc9410ccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.426794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a6087b2a-494c-4c6e-b4fd-4e0ff082a9d3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.428032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a6087b2a-494c-4c6e-b4fd-4e0ff082a9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.467702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 775/1553] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.472953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.472953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.472953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.489354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.490378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.498982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 776/1554] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.500138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.510289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 779/1555] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.516868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419f60-5c1f-46ed-a5ed-7edd8dbe7616 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.517524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419f60-5c1f-46ed-a5ed-7edd8dbe7616 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.517997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63419f60-5c1f-46ed-a5ed-7edd8dbe7616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.519916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac944b5-3f30-46b3-b36e-5591c1113ca4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.525048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.525892 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.526179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.526461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.527174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.529140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.538758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-63419f60-5c1f-46ed-a5ed-7edd8dbe7616 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.539513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-63419f60-5c1f-46ed-a5ed-7edd8dbe7616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.548562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 780/1556] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.549939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6072f-fdda-4700-a0a0-5bd6ebb26b08 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.549939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6072f-fdda-4700-a0a0-5bd6ebb26b08 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.550347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6072f-fdda-4700-a0a0-5bd6ebb26b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.560152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 777/1557] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:33.560152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.578459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-eef6072f-fdda-4700-a0a0-5bd6ebb26b08 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.579713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eef6072f-fdda-4700-a0a0-5bd6ebb26b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.631631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1634d-8d75-41ad-bfbb-a1e47e5484b8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.638269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.639213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.639213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.639512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.640194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:33.640496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.646183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.657957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 778/1558] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:33.665663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 781/1559] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.665997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.667944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43add6-4446-4591-98af-331506124582 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.668490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43add6-4446-4591-98af-331506124582 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.668985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43add6-4446-4591-98af-331506124582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.688788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0e43add6-4446-4591-98af-331506124582 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.690134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0e43add6-4446-4591-98af-331506124582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.698548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 782/1560] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.699957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2396c7-2871-40cd-a768-7c3e4bee462d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.700241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2396c7-2871-40cd-a768-7c3e4bee462d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.700520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2396c7-2871-40cd-a768-7c3e4bee462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.720367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6d2396c7-2871-40cd-a768-7c3e4bee462d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.721681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6d2396c7-2871-40cd-a768-7c3e4bee462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.730565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 783/1561] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.731896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5014a-33fe-4f62-84cd-eb98eca747f8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.732050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5639cd-fb36-4a8a-9b21-7a7dbff324ad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.732254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5014a-33fe-4f62-84cd-eb98eca747f8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.732467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5014a-33fe-4f62-84cd-eb98eca747f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.736785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.737773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.738061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.738335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.748627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.750400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.753717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-48b5014a-33fe-4f62-84cd-eb98eca747f8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.755181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-48b5014a-33fe-4f62-84cd-eb98eca747f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.761124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 779/1562] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:33.761967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.767954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 784/1563] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.767954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147f93-6016-4d21-b069-4224820dede8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.767954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147f93-6016-4d21-b069-4224820dede8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.767954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147f93-6016-4d21-b069-4224820dede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.772348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf4fc-c3cd-4daa-8693-7040f950a011 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.778242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.778924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.779204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.779476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.780188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.782857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fbdbd-bd99-4db1-a2e2-c3ccf9486b05 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.788160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-da147f93-6016-4d21-b069-4224820dede8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.789537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-da147f93-6016-4d21-b069-4224820dede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.799910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 785/1564] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.801293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147f93-6016-4d21-b069-4224820dede8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.815672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 780/1565] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:33.815672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c76c5-8c2a-4094-a071-cf647b7e226d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.815672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c76c5-8c2a-4094-a071-cf647b7e226d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.815672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c76c5-8c2a-4094-a071-cf647b7e226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.821621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147f93-6016-4d21-b069-4224820dede8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.827518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.828364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.828714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.829583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.830540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.833791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.836662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-510c76c5-8c2a-4094-a071-cf647b7e226d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.838027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-510c76c5-8c2a-4094-a071-cf647b7e226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.852117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 781/1566] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.852117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.852117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.852117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.868838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 786/1567] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:33.868838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.875384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.876881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.934842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380d199-9387-482e-bacf-90f2877dd7e4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.940224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.941588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.942073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.942589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.943349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:33.943640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.945467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa5dd0-3abe-4d75-b81f-33a23f26a39e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.946210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 782/1568] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:33.950955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:33.960370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 787/1569] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:33.960370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.960598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.960834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.970874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9ea0-a047-4ce4-beec-1b8ef4ea2053 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:33.977893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:33.978486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:33.979062 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:33.979351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:33.980102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:33.980412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:33.982061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:33.983678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:33.984949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:33.995702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 783/1570] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:33.996671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.001358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 788/1571] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:34.001358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.007268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376ce02-6bf5-4fb2-b536-76f32e31cdf1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.009520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350f5118-e498-4293-a07f-61c82c6eba64 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.012119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.012954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.013316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.013662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.014500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.015489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.016203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.016457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.017062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.017241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.018114 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:34.018655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.020739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.028187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 784/1572] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.028554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.036579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 789/1573] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:34.037587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.046872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c7b8-07e5-42f9-9463-bcb8ce2e93d2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.047517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfac6d8-fdc6-4641-bcfd-59f22d4ba36d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.053492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.054154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.054613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.055050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.055827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:34.055986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.056127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.057375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.057375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.057580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.057763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.058536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.060644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.072099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 790/1574] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:34.073200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.084284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ea928-9427-4d5c-bea4-55bb7137a40d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.090299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.091144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.091431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.091702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.092417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.093453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 785/1575] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 290 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.094588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.097251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.108642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6bba3-ba79-4729-969e-e272a3b60424 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.114727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.115538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.115978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.116100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.116920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:34.117216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.118874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.131889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 791/1576] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/projects => generated 387 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.132910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.137386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 786/1577] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:19:34.138272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.151220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500bb7a-4136-4753-80f8-df9044e0d78f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.209148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5474811-4ecf-42a8-b42a-4dce0b5551d4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.214756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.215413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.215691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.215964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.216670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.218747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.226697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.227556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.227942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.228314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.229202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.231375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.243052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 787/1578] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.246311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.250219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 792/1579] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.254599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.259362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25a35-62f1-46b1-8342-20464948ff9a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.334026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8163fb-ea66-4a4c-82c7-842219f9d41c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.334287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.334766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.335290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.335481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.336192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.338209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.340833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.341922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.342433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.342781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.343720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.345786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.367645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 788/1580] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.368708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.375895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 793/1581] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.376830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.443166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b4cd3-3e21-4bb0-80b3-604128f2be0e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.447751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.448616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.448741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.449085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.449830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.451443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.453398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c831d-4b53-4abf-8723-dc81179f0925 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.459594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.460384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.460744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.461124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.461912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.463187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 789/1582] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.464333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.466456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.479006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8127d-992f-4d22-9977-3df90593f529 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.484970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.486872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.488470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.489275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.490516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.491948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 794/1583] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.492465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.498190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.503129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6eb5eb-93c2-46ad-ba7f-a9dcd47bc069 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.509852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.510930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.511288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.511633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] PATH_INFO: `/v3/projects/e4ef5a0f7e5040c0aa3d33d31fbbb206/users/6ae6b80b4cb946208c461caebad57faa/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.543065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ef5a0f7e5040c0aa3d33d31fbbb206, user_id=6ae6b80b4cb946208c461caebad57faa, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.546500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.548142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 790/1584] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.549201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.569853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 795/1585] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:34 2022] PUT /identity/v3/projects/e4ef5a0f7e5040c0aa3d33d31fbbb206/users/6ae6b80b4cb946208c461caebad57faa/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:34.571067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.628921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34739f36-25bc-42df-a009-40e02cf974dd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.647727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19b4b7-3783-48ae-8fe5-4326f1592f24 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.653088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.653839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.654184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.654566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.655296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.657509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.685132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 796/1586] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.689035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.694786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.695564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.696191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.696370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.697321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.699348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.699672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5c3a-ab7c-47d3-985e-8b10b1af7476 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.704606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.705311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.705656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.705942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.707479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.709627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.724921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 791/1587] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.726063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.736650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 797/1588] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 279 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.736650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.736969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa690e-f314-4f13-986e-40af9c2c9b96 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.741902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.742580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.742866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.743145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.743886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.744374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0e388-ccdc-4e63-ae88-187994c42d47 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.745546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.749103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.750028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.750310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.750580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.751434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.753145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24936289-c6d3-43ca-a8ac-f9728739f62d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.762050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 792/1589] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.762938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.767195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 798/1590] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.767195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.767195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.767195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.774219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7c6f7-bba9-46a2-a80f-7f60e8fa118a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.778889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.779616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.779962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.780243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.780974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.782911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca5f8-1a39-4ed3-8bd2-d8c1475fb4a9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.794906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] MFA Rules not processed for user `a2f544b022f84fb291d0794dca05788d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:34.796333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:34.802607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 793/1591] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:34.803922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.804224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.804503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.822532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:34.823727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:34.831415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 794/1592] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:34.832861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.842397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325cd72-b80f-4ee2-9799-5fdb61b2dbee None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.847317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.847981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.848263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.848532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.849375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.851033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.864197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 795/1593] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.864197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.866418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 799/1594] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:34.867325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.871970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee156-017b-4734-9897-6c11252b1004 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.877216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.877875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.878156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.879088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.879391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45131d11-05f5-40cd-bf8a-6d5ede11f1c8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.879912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.881684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.884461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.885223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.885509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.885787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.886534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.888134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.892119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 796/1595] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.895937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.899799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 800/1596] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.900787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.905146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2b7d6-2f82-4109-ae0b-962488d69325 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.910459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.910800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9e9fc-611c-41e2-9254-140f8b491d60 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.911340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.911619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.911891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] PATH_INFO: `/v3/projects/9ea72854422249cdb2433b90e5aa1252/users/2bc8a6f3334b4cb6bacb2757007578b1/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.915464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.916110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.916384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.916658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:34.917423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.919016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.927694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea72854422249cdb2433b90e5aa1252, user_id=2bc8a6f3334b4cb6bacb2757007578b1, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:34.929719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 801/1597] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:34.930382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:34.930613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.940636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f612c-917e-4ff7-9684-0fc40bcee592 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.944236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 797/1598] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:34 2022] PUT /identity/v3/projects/9ea72854422249cdb2433b90e5aa1252/users/2bc8a6f3334b4cb6bacb2757007578b1/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:34.945325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:34.998109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:34.998378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd03c04-67b8-4f5f-8a81-b47bd5db849d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:34.998785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:34.999071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:34.999604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.000340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.001990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.002119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.002733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.003017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.003851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.013026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 802/1599] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:35.013335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.014048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.014853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017caa9-f873-48cd-a4ba-9fedb0c0c549 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.024750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 798/1600] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:35.025577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761c263-5928-4549-b108-469a515b6e5d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.026119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.026476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.026760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.031164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.031813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.032099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.032378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.033203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.034904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.044504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] MFA Rules not processed for user `a2f544b022f84fb291d0794dca05788d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.045981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.046895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 803/1601] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:35.049502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.062426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4dfd2-fad0-4557-821b-f8aaaf64ec8f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.068333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.069182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.069534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.069879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.070700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.072388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.087732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 804/1602] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:35.087732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.102525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10d79b-58e5-43af-871a-8b2d90f2092b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.110298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.112182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.113507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.113804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.114793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.116719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0966c-ef08-47d5-ad90-dd0a01f76b68 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.121960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 799/1603] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.123383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.139494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195794-83dc-4535-856f-7e3faa7a1dbe None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.140379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 805/1604] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:35.141849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.142165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.142440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.148965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.149978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.150337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.152272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] PATH_INFO: `/v3/projects/b6908f5f033f4c8888210c0cf405f4fa/users/246b8f1d109749f3a8cf3da973aacaac/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.164096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.165414 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.170296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6908f5f033f4c8888210c0cf405f4fa, user_id=246b8f1d109749f3a8cf3da973aacaac, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.171717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.177436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 806/1605] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.178498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.188605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 800/1606] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:35 2022] PUT /identity/v3/projects/b6908f5f033f4c8888210c0cf405f4fa/users/246b8f1d109749f3a8cf3da973aacaac/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:35.193251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fe510-2352-47b5-b2dc-df46b3cb4290 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.193397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.268786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba4f33-068c-4fda-8d2e-fa3902a17bad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.272729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.273521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.273870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.274119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.274218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.274907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.275031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.275189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.275669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] PATH_INFO: `/v3/projects/341c36ce76ca43918770a6da0832404e/users/6ddb3bdfe7ee4298946189b4274c69da/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.277250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.287760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 807/1607] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:35.288710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.292773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341c36ce76ca43918770a6da0832404e, user_id=6ddb3bdfe7ee4298946189b4274c69da, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.296292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.302927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12a8e1-c95f-4419-bc13-46e318d1e47e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.308684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.309602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.309884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.310158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] PATH_INFO: `/v3/projects/f8bc531651b748a791dbbbc11ee10adb/users/0ec544bab4b94d5e95eaf793afc0138c/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.315069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 801/1608] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:35 2022] PUT /identity/v3/projects/341c36ce76ca43918770a6da0832404e/users/6ddb3bdfe7ee4298946189b4274c69da/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:35.316809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.332319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8bc531651b748a791dbbbc11ee10adb, user_id=0ec544bab4b94d5e95eaf793afc0138c, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.335723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bca873-4c0e-4e6b-a3fe-8e9c724fd982 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.359352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 808/1609] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:35 2022] PUT /identity/v3/projects/f8bc531651b748a791dbbbc11ee10adb/users/0ec544bab4b94d5e95eaf793afc0138c/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:35.359352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.359352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.359352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.362021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 809/1610] 10.222.0.45 () {54 vars in 961 bytes} [Tue Feb 15 04:19:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:35.363979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.365846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.419950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5165be9-f995-4b10-8d93-630e4408fc91 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.436924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea2601-8c74-4b24-9dc4-6edc27bdfb54 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.440984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.441971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.442251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.442663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.491047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.493069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.493454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.493751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] PATH_INFO: `/v3/projects/215dcd5d41ee4c60be5a0266f4ae5e66/users/b423c9f291c94f70b2bd14bf8bca270c/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.513493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.514704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215dcd5d41ee4c60be5a0266f4ae5e66, user_id=b423c9f291c94f70b2bd14bf8bca270c, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.515100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6b0cd-d5bf-48ca-9536-40d881db9ba7 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.517706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.526384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 810/1611] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:35.527581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c23f-0741-477e-bbcd-8802ed59cdb4 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.527869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c23f-0741-477e-bbcd-8802ed59cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.528155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09c23f-0741-477e-bbcd-8802ed59cdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.540983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 802/1612] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:35 2022] PUT /identity/v3/projects/215dcd5d41ee4c60be5a0266f4ae5e66/users/b423c9f291c94f70b2bd14bf8bca270c/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:35.540983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.554967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3b09c23f-0741-477e-bbcd-8802ed59cdb4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.556558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b09c23f-0741-477e-bbcd-8802ed59cdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.626309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 811/1613] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.627495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62ff3-c87a-4190-b6d4-f3db08eef145 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.627787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62ff3-c87a-4190-b6d4-f3db08eef145 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.628792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae62ff3-c87a-4190-b6d4-f3db08eef145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.637304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d57-cdc6-40f1-844e-a0fab57e2a56 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.642573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.643551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.645204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.645204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] PATH_INFO: `/v3/projects/48c0db00438947fb92aaabf8804274c5/users/115f516273604bb280d5f80939bd0af3/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.648189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6ae62ff3-c87a-4190-b6d4-f3db08eef145 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.649101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6ae62ff3-c87a-4190-b6d4-f3db08eef145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.660590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 812/1614] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.660590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e75d-5fca-46fd-b094-ec1c6f1b926c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.660590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e75d-5fca-46fd-b094-ec1c6f1b926c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.660590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049e75d-5fca-46fd-b094-ec1c6f1b926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.670078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c0db00438947fb92aaabf8804274c5, user_id=115f516273604bb280d5f80939bd0af3, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:35.673214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d12e5c-83ad-48a5-87cf-9814063f65bf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:35.682530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8049e75d-5fca-46fd-b094-ec1c6f1b926c None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.684273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8049e75d-5fca-46fd-b094-ec1c6f1b926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.690956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 803/1615] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:35 2022] PUT /identity/v3/projects/48c0db00438947fb92aaabf8804274c5/users/115f516273604bb280d5f80939bd0af3/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:35.698500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.698889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.699197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.741762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] MFA Rules not processed for user `6ddb3bdfe7ee4298946189b4274c69da`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.743044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.817489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 813/1616] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.818891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.819178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.819453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.843679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 804/1617] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.843679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.853361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] MFA Rules not processed for user `b423c9f291c94f70b2bd14bf8bca270c`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:35.854640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:35.911073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45d2ef-6c3e-4802-a852-a6e893d1a986 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.915873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.916621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.916999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.917362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:35.945172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 814/1618] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:35.947288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:35.960765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054af56-8dce-47cc-90fb-eb56c9e53cbb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:35.965960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:35.966629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:35.966988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:35.967180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.007647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.009351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f37eb6-9933-4c73-a471-df550bb04cef service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.020980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 805/1619] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:36.022648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.023301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.023772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.063321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] MFA Rules not processed for user `115f516273604bb280d5f80939bd0af3`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:36.064794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:36.067777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.069755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.083988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 815/1620] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:36.084993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.131197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745d8c-93b5-4023-b3c1-dfd3a59ff3f4 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.139523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.141142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.141504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.141936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.164838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 806/1621] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:36.165860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.185747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be74fd6-3fd3-4e89-84e4-cf47a35495ab None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.192842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.193884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.194269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.194652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.195474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.197660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.244573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 807/1622] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:36.245424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.287250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.289115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0567da-1fcc-4728-bd30-819bfb8704ea service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.317000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 816/1623] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:36.319728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fceb52-3326-4d0b-9717-67b691253a1d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.320144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fceb52-3326-4d0b-9717-67b691253a1d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.321196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fceb52-3326-4d0b-9717-67b691253a1d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.323135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 817/1624] 10.222.0.45 () {54 vars in 961 bytes} [Tue Feb 15 04:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:36.327101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fceb52-3326-4d0b-9717-67b691253a1d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.388793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef4524-8fbd-4c49-ac4a-51a0fa3ba871 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.402171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.403958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.404355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.406272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.407063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.413093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25541126-93a3-46cc-8b5a-099fd0fa114e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.475643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 808/1625] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/projects => generated 357 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:36.478980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.479996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.480298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.508214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fceb52-3326-4d0b-9717-67b691253a1d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.520803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:36.523649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:36.655750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.656438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.657145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.657501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.662361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.664449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.686552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 809/1626] 10.222.0.45 () {58 vars in 1058 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:36.687681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.704032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 818/1627] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/users => generated 297 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:36.705537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.712161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5870d40-433a-4940-a81a-dd73d68d55c7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.727162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.728087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.728381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.728660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.729474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.731955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.749907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f866b-4552-479e-88d0-af8545f0ebfa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.763141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.763785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.764069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.764342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.800930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 810/1628] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:36.801603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.821002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e0e8-2f7f-4974-b70d-05e0a7e76df0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.838596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.839558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.840010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.840452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.841599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.843602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.851724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.853392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166b075-dd62-4e97-af04-ac9fadd28251 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.869373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 811/1629] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:36.871515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 819/1630] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:36.871655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.873300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3283-27ba-4204-ae8c-83f11920641d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.873765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3283-27ba-4204-ae8c-83f11920641d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.874046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff3283-27ba-4204-ae8c-83f11920641d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.887646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a0cc-e2a2-4d7a-b566-96dd941aa81d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.894518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.897583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.898739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.898739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:36.899754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:36.903170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:36.929398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 812/1631] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:36.934627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:36.946285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4fff3283-27ba-4204-ae8c-83f11920641d None None] MFA Rules not processed for user `2bc8a6f3334b4cb6bacb2757007578b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:36.947535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4fff3283-27ba-4204-ae8c-83f11920641d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:36.958879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be93302-53cf-46c3-88ae-9103ad7f8d2a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:36.971923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:36.974372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:36.974687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:36.975006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] PATH_INFO: `/v3/projects/bcd25118979e42dcbfc684d6a81d53f9/users/03a46eaa8685487d9124e9aa0d4a7599/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.014855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd25118979e42dcbfc684d6a81d53f9, user_id=03a46eaa8685487d9124e9aa0d4a7599, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.020459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.051805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 813/1632] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:36 2022] PUT /identity/v3/projects/bcd25118979e42dcbfc684d6a81d53f9/users/03a46eaa8685487d9124e9aa0d4a7599/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:37.052783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.106917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 820/1633] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:37.108401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19958-edce-4e30-a2c3-7aa2fee9bf3d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.108690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19958-edce-4e30-a2c3-7aa2fee9bf3d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.108990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19958-edce-4e30-a2c3-7aa2fee9bf3d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.110783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 821/1634] 10.222.0.45 () {54 vars in 912 bytes} [Tue Feb 15 04:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:37.115390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19958-edce-4e30-a2c3-7aa2fee9bf3d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.207965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c3de9-1db0-4587-a2c4-0fdab4886a8c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:37.219807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:37.220721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.221047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.221797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] PATH_INFO: `/v3/projects/e39e02a653aa43468ca78d715630ccce/users/9b8afcde2aed4e90bce4743596438c32/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.261843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39e02a653aa43468ca78d715630ccce, user_id=9b8afcde2aed4e90bce4743596438c32, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.266979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cc83c-3496-490f-9681-2a4fe4520456 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.271704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19958-edce-4e30-a2c3-7aa2fee9bf3d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:37.280088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:37.280933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.281096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.281376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.282516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.284154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818facf-0831-4a79-8cbc-d02d89062217 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.298281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 822/1635] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:37.299717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab89a-70c8-4b9b-b4c6-ef37c4376336 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.300015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab89a-70c8-4b9b-b4c6-ef37c4376336 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.301018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab89a-70c8-4b9b-b4c6-ef37c4376336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.304072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 814/1636] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:37 2022] PUT /identity/v3/projects/e39e02a653aa43468ca78d715630ccce/users/9b8afcde2aed4e90bce4743596438c32/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:37.308724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.309048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.309337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.321567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-91dab89a-70c8-4b9b-b4c6-ef37c4376336 None None] MFA Rules not processed for user `2bc8a6f3334b4cb6bacb2757007578b1`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:37.323123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-91dab89a-70c8-4b9b-b4c6-ef37c4376336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:37.347666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:37.350864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:37.428479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 823/1637] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:37.433558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bad75-d427-4dc2-942d-6dc59bc37725 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.433837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bad75-d427-4dc2-942d-6dc59bc37725 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.435095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bad75-d427-4dc2-942d-6dc59bc37725 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.439887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 824/1638] 10.222.0.45 () {54 vars in 912 bytes} [Tue Feb 15 04:19:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:37.448021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bad75-d427-4dc2-942d-6dc59bc37725 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.465331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 815/1639] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:37.466722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.561066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4951a9-82b1-46da-b0bf-9f1d9ff9d4fe None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:37.568022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:37.568999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.569382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.569896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.571380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.573359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a12823-abab-4b38-9b6f-7999b39ea7a7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.574169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bad75-d427-4dc2-942d-6dc59bc37725 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:37.586901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:37.587914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.588277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.588959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] PATH_INFO: `/v3/projects/bcd25118979e42dcbfc684d6a81d53f9/users/03a46eaa8685487d9124e9aa0d4a7599/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.593987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd25118979e42dcbfc684d6a81d53f9, user_id=03a46eaa8685487d9124e9aa0d4a7599, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.594860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 816/1640] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:37.596529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.596825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.598734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.601105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.627615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:37.630267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:37.632563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 825/1641] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:37 2022] PUT /identity/v3/projects/bcd25118979e42dcbfc684d6a81d53f9/users/03a46eaa8685487d9124e9aa0d4a7599/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:37.633247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.635021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:37.801628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd0f72-3529-497c-a4e5-85a7a3bfc172 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:37.807573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 817/1642] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:37.808007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:37.809453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.809749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:37.809931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.810284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:37.836037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:37.837998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b38ccd2-4264-413b-9c8d-5585306ac575 service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:37.898953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 826/1643] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:37.904129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a971cf-6d76-4395-893f-236e3a54e47d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:37.904817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a971cf-6d76-4395-893f-236e3a54e47d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:37.906491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a971cf-6d76-4395-893f-236e3a54e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.002294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-34a971cf-6d76-4395-893f-236e3a54e47d None None] MFA Rules not processed for user `03a46eaa8685487d9124e9aa0d4a7599`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:38.005407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-34a971cf-6d76-4395-893f-236e3a54e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:38.031397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad3467-2701-430a-be82-ae47c0a69980 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:38.044124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:38.048430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:38.048871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:38.050871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] PATH_INFO: `/v3/projects/e39e02a653aa43468ca78d715630ccce/users/9b8afcde2aed4e90bce4743596438c32/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.131323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39e02a653aa43468ca78d715630ccce, user_id=9b8afcde2aed4e90bce4743596438c32, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:38.131323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:38.131323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 818/1644] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:37 2022] PUT /identity/v3/projects/e39e02a653aa43468ca78d715630ccce/users/9b8afcde2aed4e90bce4743596438c32/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:38.131323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:38.233056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 827/1645] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:38.244793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:38.245111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:38.245394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.320091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e5b9b-50ea-4a0f-9add-d0650292f680 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:38.322725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] MFA Rules not processed for user `9b8afcde2aed4e90bce4743596438c32`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:38.324098 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:38.326408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:38.327406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:38.327920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:38.328413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.492137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:38.495006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:38.500153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 828/1646] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:38.506554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:38.525354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 819/1647] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:38.526561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc08557-e961-434e-993d-d904d89adc57 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:38.539536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:38.540207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:38.540488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:38.540774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.665368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:38.666854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e6c7-e3e6-4879-b472-5e5c4fea6163 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:38.692473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 829/1648] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:38.744512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:38.754993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb6eb0-2b85-4a26-9fad-6e8f6be03ad7 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:38.770612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:38.778150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:38.778507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:38.778771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:38.802486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:38.803965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84339d7-04b1-45bd-a83e-2d27183c69cb service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:38.845912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 820/1649] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:39.026831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91069-908d-4fab-a9f6-3be518fb0462 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.027342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91069-908d-4fab-a9f6-3be518fb0462 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.027437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c91069-908d-4fab-a9f6-3be518fb0462 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:39.031838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 830/1650] 10.222.0.45 () {54 vars in 912 bytes} [Tue Feb 15 04:19:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:39.039926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.040537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.040537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:39.158293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:39.163890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:39.173910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91069-908d-4fab-a9f6-3be518fb0462 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:39.195073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c91069-908d-4fab-a9f6-3be518fb0462 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:39.204847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:39.205874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.208251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.209542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:39.317214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 821/1651] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:39.374700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:39.376784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:39.398114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:39.409898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f37e3f-f67e-4c73-9b9d-d509914685b1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:39.411259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 831/1652] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:39.420278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:39.422004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.423591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.423998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:39.458036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:39.459775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:39.485018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 822/1653] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:39.845930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:39.867800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc9119-8f6f-477d-9f56-cb28e486c9b0 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:39.880389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:39.881845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.882198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.882681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:39.912006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:39.932052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a875311-fc48-4b20-8d4e-c9cf4b000ac5 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:39.948651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:39.949376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:39.949666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:39.949948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:40.038837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:40.046089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e93b9-ca6f-423a-b1b9-14ec19daef82 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:40.080745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 832/1654] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:40.171384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:40.179559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8a53f-5cb0-4ca0-9fd4-dc6686766ba8 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:40.223602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 823/1655] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:40.606422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c24e-7b63-4aa9-b505-feb2302600f8 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:40.607336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c24e-7b63-4aa9-b505-feb2302600f8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:40.607860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654c24e-7b63-4aa9-b505-feb2302600f8 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:40.612652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 833/1656] 10.222.0.45 () {54 vars in 960 bytes} [Tue Feb 15 04:19:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:40.618753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0aef-e93d-4141-a1e2-a55bdf9a51b7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:40.619342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0aef-e93d-4141-a1e2-a55bdf9a51b7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:40.619760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b0aef-e93d-4141-a1e2-a55bdf9a51b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:40.659898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2e6b0aef-e93d-4141-a1e2-a55bdf9a51b7 None None] MFA Rules not processed for user `c8282bf8c7464ea5a8a84e84b3534ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:40.661804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2e6b0aef-e93d-4141-a1e2-a55bdf9a51b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:40.880195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 824/1657] 10.222.0.45 () {58 vars in 1057 bytes} [Tue Feb 15 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:40.882569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654c24e-7b63-4aa9-b505-feb2302600f8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:40.907336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654c24e-7b63-4aa9-b505-feb2302600f8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:40.924134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:40.925770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:40.926238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:40.926683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:40.929163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:40.958097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:40.960100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7cab2-cecd-4d4c-b6f5-200b4c2f4ce5 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:40.983697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 834/1658] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:41.616700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e976-5295-4fdb-b844-b102cc856c99 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:41.616700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e976-5295-4fdb-b844-b102cc856c99 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:41.617428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20e976-5295-4fdb-b844-b102cc856c99 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:41.625057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 825/1659] 10.222.0.45 () {54 vars in 912 bytes} [Tue Feb 15 04:19:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:19:41.632634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:41.633652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:41.634131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:41.680775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:41.686467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:41.707059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 835/1660] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:41.852212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e976-5295-4fdb-b844-b102cc856c99 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:41.871382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20e976-5295-4fdb-b844-b102cc856c99 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:41.902274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:41.903917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:41.904208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:41.904484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:41.930970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:41.942431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a31c-ea4f-4ed0-a5a0-415f328ce0b7 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:41.967461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 826/1661] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:43.363796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:43.448005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd564a6-c38b-4a7c-9bea-78059a4a9ffb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:43.455196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:43.457815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:43.458271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:43.458710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] PATH_INFO: `/v3/users/115f516273604bb280d5f80939bd0af3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:43.460159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=115f516273604bb280d5f80939bd0af3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:43.464162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:43.531766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115f516273604bb280d5f80939bd0af3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:43.547379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115f516273604bb280d5f80939bd0af3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:43.548595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115f516273604bb280d5f80939bd0af3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:43.558032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115f516273604bb280d5f80939bd0af3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:43.570358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115f516273604bb280d5f80939bd0af3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:43.580529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 836/1662] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:19:43 2022] DELETE /identity/v3/users/115f516273604bb280d5f80939bd0af3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:43.584765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:43.585421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:43.585936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:43.613438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:43.615027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:43.728584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 827/1663] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:43.891189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:43.892759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:43.988800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168ef4-f301-4fc8-abbc-1501fab5c7bd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:43.993336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:43.994019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:43.994306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:43.994585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:44.007248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:44.008791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9239b14-56da-4d42-85f3-9f97c33d93d6 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:44.021525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 837/1664] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:44.281552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:44.283373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:44.309109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b2b31-cd33-488b-a6d6-bf8df0f58514 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:44.323668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023cb9-6ec5-4b40-bce1-245c47418355 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:44.324054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023cb9-6ec5-4b40-bce1-245c47418355 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:44.324213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a023cb9-6ec5-4b40-bce1-245c47418355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:44.328743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:44.350021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:44.352485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:44.363971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] PATH_INFO: `/v3/users/6ddb3bdfe7ee4298946189b4274c69da` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:44.368003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ddb3bdfe7ee4298946189b4274c69da)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:44.369704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: WARNING py.warnings [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:19:44.369704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: warnings.warn(msg) Feb 15 04:19:44.369704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: Feb 15 04:19:44.371398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:44.395660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8a023cb9-6ec5-4b40-bce1-245c47418355 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:44.397731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8a023cb9-6ec5-4b40-bce1-245c47418355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:44.600813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 838/1665] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:44.608365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ddb3bdfe7ee4298946189b4274c69da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:44.609350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ddb3bdfe7ee4298946189b4274c69da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:44.663954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ddb3bdfe7ee4298946189b4274c69da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:44.738121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ddb3bdfe7ee4298946189b4274c69da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:44.742989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ddb3bdfe7ee4298946189b4274c69da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:44.785054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 828/1666] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:19:44 2022] DELETE /identity/v3/users/6ddb3bdfe7ee4298946189b4274c69da => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:44.789574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:44.789860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:44.790411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:44.804981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:44.807889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:44.821200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:44.822870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:44.903858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 839/1667] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:44.997854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e01f3-9b88-403c-adb0-67cc8d13e782 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:45.024818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:45.025608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:45.027094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:45.027462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:45.032781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:45.065140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:45.067387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:45.319163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc5182-e151-4154-854d-304546bc2135 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:45.336032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:45.337428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:45.338146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:45.342027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:45.381214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:45.392680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:45.418667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:45.421506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c2638-3a4b-4888-ae89-1be8e6614555 service swift] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:45.445255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 840/1668] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:45.455488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 829/1669] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:19:46.646166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:46.650977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:46.711118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134c3c2-8742-423d-a84a-92d4c06a8c18 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:46.750389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:46.751893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:46.756248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:46.758449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] PATH_INFO: `/v3/projects/48c0db00438947fb92aaabf8804274c5` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:46.764284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c0db00438947fb92aaabf8804274c5)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:46.775424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: WARNING py.warnings [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 15 04:19:46.775424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: warnings.warn(msg) Feb 15 04:19:46.775424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: Feb 15 04:19:46.789713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:47.118321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c0db00438947fb92aaabf8804274c5', 'request_id': 'req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:47.153311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c0db00438947fb92aaabf8804274c5', 'request_id': 'req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:47.270752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c0db00438947fb92aaabf8804274c5', 'request_id': 'req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:47.300306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] The token cache is being invalidate because project 48c0db00438947fb92aaabf8804274c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:19:47.300812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:47.317692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-51dc0519-7f22-4fbc-baf2-75f13eb1b2b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:47.334550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 841/1670] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:19:46 2022] DELETE /identity/v3/projects/48c0db00438947fb92aaabf8804274c5 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:47.337198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:47.337984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:47.337984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:47.387513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:47.391235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:47.620760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 830/1671] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:47.630138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:47.630506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:47.630971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:47.680684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:47.686927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:47.703734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 842/1672] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:47.709887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:47.731498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d3014-fb15-47aa-8f9e-d165de188b40 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:47.744675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:47.746535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:47.759789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:47.760478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:47.760772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:47.761094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:47.761844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:47.762442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:47.773012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:47.799071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe45dd-18a6-4389-bf64-16cc0b7a42b8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:47.834215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 831/1673] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:19:47.839136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:47.856801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:47.879521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d8d68-f3ce-46d1-8930-76e8d78f5b50 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:47.880439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:47.881057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:47.881519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] PATH_INFO: `/v3/projects/341c36ce76ca43918770a6da0832404e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:47.898155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=341c36ce76ca43918770a6da0832404e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:47.901083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:47.902049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:47.902491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:47.902978 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:47.903888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:47.906256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:47.908365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:47.982099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 832/1674] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:47 2022] POST /identity/v3/projects => generated 403 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:47.986088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:48.182779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba32865-4761-4a41-88cd-7b29787df467 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:48.225996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341c36ce76ca43918770a6da0832404e', 'request_id': 'req-a4221014-0aca-445e-8d45-f12626be46c5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.271933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341c36ce76ca43918770a6da0832404e', 'request_id': 'req-a4221014-0aca-445e-8d45-f12626be46c5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.307938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341c36ce76ca43918770a6da0832404e', 'request_id': 'req-a4221014-0aca-445e-8d45-f12626be46c5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.363481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] The token cache is being invalidate because project 341c36ce76ca43918770a6da0832404e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:19:48.364297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.364453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:48.365277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.365543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.365833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.366624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:48.369783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:48.387231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.395746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 843/1675] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:19:47 2022] DELETE /identity/v3/projects/341c36ce76ca43918770a6da0832404e => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:19:48.401630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:48.416710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 833/1676] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:47 2022] POST /identity/v3/users => generated 302 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:48.418357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:48.420518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:48.435136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:48.444760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df3d76-25c3-4697-bae9-122a733c2b19 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:48.451811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:48.453325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.454008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.454568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.455547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:48.458891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:48.476806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 834/1677] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:48.481339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:48.495191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7955c7a-5bc5-4bd3-b4e5-36f14b668417 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:48.498483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4221014-0aca-445e-8d45-f12626be46c5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:48.504790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:48.505531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.505824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.506204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.506965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:48.509119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:48.524399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:48.525631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 835/1678] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:48.527312 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.527807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.528320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] PATH_INFO: `/v3/users/03a46eaa8685487d9124e9aa0d4a7599` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.530451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:48.532865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a46eaa8685487d9124e9aa0d4a7599)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:48.537858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:48.547207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4fdce1-c8d2-48fb-bdcc-6e73d8e8b8ff admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:48.563095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:48.565229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.568262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.569314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] PATH_INFO: `/v3/projects/b84eb0c035234cf5932b7860e40470c0/users/b7485a44b66541aaa24ab3b83dbc815d/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.614256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84eb0c035234cf5932b7860e40470c0, user_id=b7485a44b66541aaa24ab3b83dbc815d, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:48.624680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab727ae-97c5-4847-8cc6-2b353b1e2baa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:48.672701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 836/1679] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:48 2022] PUT /identity/v3/projects/b84eb0c035234cf5932b7860e40470c0/users/b7485a44b66541aaa24ab3b83dbc815d/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:48.695538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.699358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.701699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:48.787283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a46eaa8685487d9124e9aa0d4a7599'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.852370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:48.856677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:48.859834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a46eaa8685487d9124e9aa0d4a7599'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.870115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a46eaa8685487d9124e9aa0d4a7599'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.890405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a46eaa8685487d9124e9aa0d4a7599'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.918257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e49ec709-fe5c-4fb6-a97b-a1f374770077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a46eaa8685487d9124e9aa0d4a7599'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:48.964057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 844/1680] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:19:48 2022] DELETE /identity/v3/users/03a46eaa8685487d9124e9aa0d4a7599 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:48.964057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:48.973785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:48.974314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:49.063546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:49.072817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:49.170478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 837/1681] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Feb 15 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:49.210023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 845/1682] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:49.244527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:49.244721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:49.282095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:49.294719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb530f-63c7-4517-ac23-69567e8bd2e4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:49.418047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71c29-34cc-465c-bc1a-0a4c9faa02c3 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:49.448132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:49.449431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:49.449916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:49.450401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:49.544791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:49.550701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:49.552006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:49.556086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:49.560232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:49.560705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:49.609690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:49.611560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d92b8f-9bd2-4bff-b931-cf9e1a5e4bf8 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:49.633233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 846/1683] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:49.657075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 838/1684] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:52.566058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:52.570166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:52.595874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f256a-40c3-48b9-942e-f08dcdfb541c service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:52.637086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:52.638433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:52.641195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:52.643423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] PATH_INFO: `/v3/projects/bcd25118979e42dcbfc684d6a81d53f9` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:52.646989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd25118979e42dcbfc684d6a81d53f9)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:52.650987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:52.849438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd25118979e42dcbfc684d6a81d53f9', 'request_id': 'req-4788e2f5-20e2-4118-95f5-b705a650f213'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:52.864555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd25118979e42dcbfc684d6a81d53f9', 'request_id': 'req-4788e2f5-20e2-4118-95f5-b705a650f213'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:52.894664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd25118979e42dcbfc684d6a81d53f9', 'request_id': 'req-4788e2f5-20e2-4118-95f5-b705a650f213'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:52.921521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] The token cache is being invalidate because project bcd25118979e42dcbfc684d6a81d53f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:19:52.922281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:52.923781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4788e2f5-20e2-4118-95f5-b705a650f213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:52.927551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 847/1685] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:19:52 2022] DELETE /identity/v3/projects/bcd25118979e42dcbfc684d6a81d53f9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:52.934635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:52.935269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:52.935269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:52.976686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:52.977867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:53.088813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 839/1686] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:53.106761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.108780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.110000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:53.164842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:53.166661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:53.189187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:53.189594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 848/1687] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:53.224983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2b3b6-b8a1-487b-bebe-0b4844c8b2ef None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:53.250622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:53.251853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.252338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.252942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:53.254434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:19:53.255183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:53.261927 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:53.316376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 840/1688] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:19:53.318338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:53.343448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d9f91-3e46-411a-8d29-c6f7722f8faf None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:53.352792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:53.353940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.354496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.355030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:53.356093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:53.361394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea311-13fb-4727-8280-6d2b68ea1419 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:53.427009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:53.427776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 849/1689] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:53 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:53.477687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f203de8-4321-41ad-a842-4247f667de24 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:53.851422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:53.852793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.853844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.853844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:53.855120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:53.865531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea0266-87fd-45ea-a77c-5f0d45573de3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:53.895179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cdc-c7c2-4ccf-8986-ef3e209b0596 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.896051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cdc-c7c2-4ccf-8986-ef3e209b0596 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.896997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e3cdc-c7c2-4ccf-8986-ef3e209b0596 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:53.901582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 850/1690] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:19:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:19:53.937418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 841/1691] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:53 2022] POST /identity/v3/users => generated 293 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:53.942258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3cdc-c7c2-4ccf-8986-ef3e209b0596 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:53.987966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b842ce-0f9a-41d4-b280-1b82bf11575e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:53.989027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b842ce-0f9a-41d4-b280-1b82bf11575e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:53.989750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b842ce-0f9a-41d4-b280-1b82bf11575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.010043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e3cdc-c7c2-4ccf-8986-ef3e209b0596 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:54.031592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:54.033217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:54.033739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:54.036952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.039701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:54.046575 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:54.055869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c8b842ce-0f9a-41d4-b280-1b82bf11575e None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:54.062831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c8b842ce-0f9a-41d4-b280-1b82bf11575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:54.076423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 851/1692] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:54.078104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:54.101035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa988a-7d6e-4c6a-8249-b78f10f69f98 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:54.111290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:54.113638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:54.113972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:54.114461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.115951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:54.119559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:54.157787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 852/1693] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:54.161518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:54.202842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d587c-84a9-41ed-b5c6-50d02103a4e6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:54.238302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:54.241080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:54.241820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:54.242549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] PATH_INFO: `/v3/projects/b012339b77cc4672b91775fd58e8ed98/users/4cb6423c7570483b887e1e93dcf67898/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.319822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b012339b77cc4672b91775fd58e8ed98, user_id=4cb6423c7570483b887e1e93dcf67898, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:54.336876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:54.373027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 842/1694] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:19:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:19:54.390613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 853/1695] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:54 2022] PUT /identity/v3/projects/b012339b77cc4672b91775fd58e8ed98/users/4cb6423c7570483b887e1e93dcf67898/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:54.402558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:54.402988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:54.403378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.466781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] MFA Rules not processed for user `4cb6423c7570483b887e1e93dcf67898`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:54.468035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:54.651730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 843/1696] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:54.665651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:54.673481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:54.675461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:54.680870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:54.918987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce46c-5122-4f19-b89b-0e5ff0d48d0b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:54.925367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:54.927018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:54.927553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:54.928135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:54.942974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:54.946590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:54.971975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 854/1697] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:55.009703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:55.054183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e2c023-3102-4b00-a15b-31b2a5a4fe16 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:55.073289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:55.074349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:55.075105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:55.075603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:55.096702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:55.099150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12601e9c-b3f5-4d42-94a4-a4fbd3b132ab service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:55.138240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 844/1698] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:55.342316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a826c-e1f6-4bf8-a9a2-516e6a19ae12 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:55.364185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:55.365709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:55.366241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:55.366696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] PATH_INFO: `/v3/users/4cb6423c7570483b887e1e93dcf67898` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:55.369209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb6423c7570483b887e1e93dcf67898)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:55.372559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:55.560928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb6423c7570483b887e1e93dcf67898'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:55.594015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb6423c7570483b887e1e93dcf67898'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:55.597775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb6423c7570483b887e1e93dcf67898'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:55.618494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb6423c7570483b887e1e93dcf67898'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:55.641411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1051eafd-372c-452e-972e-4e15d40e5af5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb6423c7570483b887e1e93dcf67898'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:19:55.670552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 855/1699] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:19:55 2022] DELETE /identity/v3/users/4cb6423c7570483b887e1e93dcf67898 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:19:55.676204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:55.676429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:55.677006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:55.755667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:55.765146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:55.948372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1c29-c6ad-4a18-a1e3-513207639446 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:55.956115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1c29-c6ad-4a18-a1e3-513207639446 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:55.957263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e1c29-c6ad-4a18-a1e3-513207639446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:56.068656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 845/1700] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:56.082030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e89e1c29-c6ad-4a18-a1e3-513207639446 None None] MFA Rules not processed for user `246b8f1d109749f3a8cf3da973aacaac`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:56.092675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e89e1c29-c6ad-4a18-a1e3-513207639446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:56.218254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:56.220820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:56.418194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01acf3b-6dcd-4ca2-ab63-da12e2f9fe0b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:56.432438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:56.433383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:56.433728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:56.434618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:56.463473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:56.466380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:56.494126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 846/1701] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:19:56.545083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 856/1702] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 593 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:57.502083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:57.503312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:57.851015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098bf81-0de6-4ceb-8c3d-9c0990d74ddb service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:57.887389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:57.890818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:57.891895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:57.894267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:57.937041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:57.938862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:57.978169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 847/1703] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:19:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:19:58.461399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:58.461997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:58.461997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:58.601695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] MFA Rules not processed for user `b7485a44b66541aaa24ab3b83dbc815d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:19:58.603435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:58.807944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 857/1704] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:19:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:19:58.814613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:58.817705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:19:58.858450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e55f-f8c1-4a95-864d-363d98cd4a1d service nova] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:58.871230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:58.872256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:58.872776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:58.873519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:58.874810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:58.879497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:58.947099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 848/1705] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:19:58 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:19:58.956221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:59.007687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05911a70-88c6-474b-ad1d-455d224c092d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:59.307631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:59.308356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:59.308650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:59.308957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:59.309723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:59.311789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:59.467236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 858/1706] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:19:58 2022] POST /identity/v3/users => generated 309 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:19:59.473798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:59.520206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb231ab-2b16-4eb6-8c16-74806ffbcd9e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:59.557187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:59.558196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:59.558738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:59.559174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:59.560119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:59.569796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:59.601174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:59.601855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 849/1707] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:19:59.615724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c2ee1-cb28-47d3-b80f-2fa5a8cbf239 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:59.649238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:59.650635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:59.651095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:59.651517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] PATH_INFO: `/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10/users/091ee3f2f3b04d9ebe72510c448ae6f8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:59.716078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a8c39aa0b42b3b1a794153d4cce10, user_id=091ee3f2f3b04d9ebe72510c448ae6f8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:59.721447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:19:59.787588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 859/1708] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:19:59 2022] PUT /identity/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10/users/091ee3f2f3b04d9ebe72510c448ae6f8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:19:59.793468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:19:59.815850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7394e4-3e20-4164-bf3a-f6a50a91be2e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:19:59.980478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:19:59.993650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:19:59.994219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:19:59.994703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:19:59.995717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:19:59.999163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d91c48-be8f-49dc-b4ec-77ee518378be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:00.032436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 850/1709] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:00.040269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:00.090793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dde2a9-0ff1-4219-8d5d-ced7538203be admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:00.107777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:00.109664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.110025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.110351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] PATH_INFO: `/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10/users/091ee3f2f3b04d9ebe72510c448ae6f8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.114181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a8c39aa0b42b3b1a794153d4cce10, user_id=091ee3f2f3b04d9ebe72510c448ae6f8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:00.118941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831394b-3779-47fa-a2a8-6cf68d7111f7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:00.129784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.130125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.130421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.132864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 851/1710] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:20:00.133736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:00.136754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:00.142405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 860/1711] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:00 2022] PUT /identity/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10/users/091ee3f2f3b04d9ebe72510c448ae6f8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:00.162707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.164584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.165069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.218012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:00.219324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:00.281590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152015d-96c9-4c86-9246-f0270efccc71 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:00.289310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:00.290637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.291123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.291558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] PATH_INFO: `/v3/projects/b012339b77cc4672b91775fd58e8ed98` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.293865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b012339b77cc4672b91775fd58e8ed98)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:00.296742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:00.381721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 861/1712] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:00.417868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:00.427832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b012339b77cc4672b91775fd58e8ed98', 'request_id': 'req-eeaff975-3598-4ac4-9435-2ff2d2e1a071'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:00.439305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b012339b77cc4672b91775fd58e8ed98', 'request_id': 'req-eeaff975-3598-4ac4-9435-2ff2d2e1a071'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:00.440531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdde2d-37e2-46ed-99d8-5c1ce5ef03f1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:00.465867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b012339b77cc4672b91775fd58e8ed98', 'request_id': 'req-eeaff975-3598-4ac4-9435-2ff2d2e1a071'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:00.510919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] The token cache is being invalidate because project b012339b77cc4672b91775fd58e8ed98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:00.513486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:00.514636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-eeaff975-3598-4ac4-9435-2ff2d2e1a071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:00.525256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 852/1713] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:00 2022] DELETE /identity/v3/projects/b012339b77cc4672b91775fd58e8ed98 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:00.530691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14af8-28f0-46ce-a92b-099623115ace None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.531265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14af8-28f0-46ce-a92b-099623115ace None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.536014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb14af8-28f0-46ce-a92b-099623115ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.573118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:00.574283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.574680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.575074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.577853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:00.595428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:00.598194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e474621-cc71-4974-b7ac-dcccf4639a25 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:00.608241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2cb14af8-28f0-46ce-a92b-099623115ace None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:00.620985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2cb14af8-28f0-46ce-a92b-099623115ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:00.622361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 862/1714] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:00.902668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 853/1715] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:00.908380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.909266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.909583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:00.975291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:00.975648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:00.976632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.003747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:01.003747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:01.030082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 863/1716] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:01.031045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.069753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1983f-73cc-4009-be57-b856a4d4c785 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.159787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.161550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.161841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.163205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.164012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:01.166427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.166967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] MFA Rules not processed for user `6ae6b80b4cb946208c461caebad57faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:01.171574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:01.173282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:01.210512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 864/1717] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:01.225829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.247817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efbc99-42c7-496d-8738-9ead2072266e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.266950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.267699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.267929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.273436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.274246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.278525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:01.337286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 865/1718] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:01 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:01.338803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.467230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3e86a-042b-49b7-aff2-af162573d344 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.475193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.475644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.475933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.476821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.478036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.480058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:01.533444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 866/1719] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:01 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:01.545281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.597016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83220d-26cf-43a4-ad41-a1c7cda43b36 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.617115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.622909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.623381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.623742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.625050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.632473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:01.667363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 867/1720] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:01.670887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.702332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12df58-f9f4-41f5-8334-587be78d258e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.751904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 854/1721] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 775 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:01.755053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.765240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.773804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.773804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.773804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.787190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d3b27-2297-4121-bc02-e9be34554431 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:01.848782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 868/1722] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:01.855207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:01.913594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ece1f7-a56b-4296-aa38-9e0640a7fbd1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:01.927589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:01.928944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:01.929441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:01.929900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] PATH_INFO: `/v3/projects/45220fca5ae1406d814191d5246511fa/users/13f6ad9af42f43d8ab98a1a3c3ed7fda/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:01.977969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45220fca5ae1406d814191d5246511fa, user_id=13f6ad9af42f43d8ab98a1a3c3ed7fda, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:01.985023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:02.030712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 855/1723] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:01 2022] PUT /identity/v3/projects/45220fca5ae1406d814191d5246511fa/users/13f6ad9af42f43d8ab98a1a3c3ed7fda/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:02.043687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:02.046093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:02.046789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:02.178635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] MFA Rules not processed for user `13f6ad9af42f43d8ab98a1a3c3ed7fda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:02.179851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:02.449384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 869/1724] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:02.453717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:02.480846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:02.481094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:02.482638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:02.639435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169db419-8677-4a54-8c29-8f183aa45746 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:02.656128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:02.656836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:02.657560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:02.658028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:02.698447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:02.709696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:02.738078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb34872-c88e-4a79-bdd0-c731d204df93 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:02.743462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 870/1725] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:02.763158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:02.764642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:02.765383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:02.766031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:02.928185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:02.931072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d8ed-7046-40af-861e-399775e7a233 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:02.957441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 856/1726] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:04.066924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:04.068515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:04.278021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b61038-eff8-4de9-bc45-eeaa23f01412 service glance] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:04.293240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:04.294418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:04.297180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:04.297763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] PATH_INFO: `/v3/users/b423c9f291c94f70b2bd14bf8bca270c` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:04.304156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b423c9f291c94f70b2bd14bf8bca270c)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:04.308383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:04.465803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b423c9f291c94f70b2bd14bf8bca270c'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:04.507460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b423c9f291c94f70b2bd14bf8bca270c'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:04.512826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b423c9f291c94f70b2bd14bf8bca270c'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:04.530003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b423c9f291c94f70b2bd14bf8bca270c'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:04.551598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b423c9f291c94f70b2bd14bf8bca270c'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:04.559773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 871/1727] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:04 2022] DELETE /identity/v3/users/b423c9f291c94f70b2bd14bf8bca270c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:04.567757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c49e-5afc-4520-aa9c-041b78fe07d2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:04.568399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c49e-5afc-4520-aa9c-041b78fe07d2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:04.568399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c49e-5afc-4520-aa9c-041b78fe07d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:04.607320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8952c49e-5afc-4520-aa9c-041b78fe07d2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:04.612242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8952c49e-5afc-4520-aa9c-041b78fe07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:04.859140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 857/1728] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:04.891650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:04.893335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:05.176971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa4cd-42b8-4b56-a344-5a02792a015e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:05.190629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:05.191601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:05.192045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:05.193341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:05.229151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:05.230979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:05.281442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 872/1729] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:06.766083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:06.766710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:06.767105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:06.842553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] MFA Rules not processed for user `091ee3f2f3b04d9ebe72510c448ae6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:06.854256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:06.994905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 858/1730] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:07.214689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:07.216270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:07.242474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495912-7a35-4c91-8987-b5497d40bbba service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:07.260612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:07.261803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:07.262249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:07.262719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] PATH_INFO: `/v3/projects/215dcd5d41ee4c60be5a0266f4ae5e66` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:07.265887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] RBAC: Authorizing `identity:delete_project(project_id=215dcd5d41ee4c60be5a0266f4ae5e66)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:07.268799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:07.390677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215dcd5d41ee4c60be5a0266f4ae5e66', 'request_id': 'req-e604aee0-8d59-48fa-a083-addfab55470a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.400340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215dcd5d41ee4c60be5a0266f4ae5e66', 'request_id': 'req-e604aee0-8d59-48fa-a083-addfab55470a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.412348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215dcd5d41ee4c60be5a0266f4ae5e66', 'request_id': 'req-e604aee0-8d59-48fa-a083-addfab55470a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.439437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] The token cache is being invalidate because project 215dcd5d41ee4c60be5a0266f4ae5e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:07.441448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.442512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e604aee0-8d59-48fa-a083-addfab55470a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.445557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 873/1731] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:07 2022] DELETE /identity/v3/projects/215dcd5d41ee4c60be5a0266f4ae5e66 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:07.451657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:07.551822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad430e-da24-4065-a696-b86ba5dc56c9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:07.731186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:07.733615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:07.734391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:07.736668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] PATH_INFO: `/v3/users/9b8afcde2aed4e90bce4743596438c32` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:07.747063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8afcde2aed4e90bce4743596438c32)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:07.759355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:07.822950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3e1-5da6-4cfb-813f-450ceca23e04 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:07.824392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3e1-5da6-4cfb-813f-450ceca23e04 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:07.824938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208e3e1-5da6-4cfb-813f-450ceca23e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:07.900094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0208e3e1-5da6-4cfb-813f-450ceca23e04 None None] MFA Rules not processed for user `0ec544bab4b94d5e95eaf793afc0138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:07.902299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0208e3e1-5da6-4cfb-813f-450ceca23e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:07.950308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8afcde2aed4e90bce4743596438c32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:07.951655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8afcde2aed4e90bce4743596438c32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:08.011037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8afcde2aed4e90bce4743596438c32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:08.025977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8afcde2aed4e90bce4743596438c32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:08.029420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3dc1faa6-6ebd-46ab-8240-2d15acc2d491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8afcde2aed4e90bce4743596438c32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:08.107359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 859/1732] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:07 2022] DELETE /identity/v3/users/9b8afcde2aed4e90bce4743596438c32 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:08.230265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 874/1733] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:08.231986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:08.232275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:08.232574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:08.275741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] MFA Rules not processed for user `0ec544bab4b94d5e95eaf793afc0138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:08.277168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:08.352406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:08.354543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:08.355065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:08.391970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] MFA Rules not processed for user `246b8f1d109749f3a8cf3da973aacaac`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:08.394840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:08.415866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 860/1734] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:08.599656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 875/1735] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:08.871552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:08.877654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:09.004574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d23336-a420-422a-b30e-ab3f0dec6d19 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:09.029019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:09.029872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:09.030325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:09.030586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:09.073827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:09.077437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe834b3-068c-44da-9b11-cd72f1a75981 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:09.127369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 861/1736] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:10.057566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:10.059377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:10.230192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7f00-14f7-42ef-b52c-381f8128f959 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:10.256525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:10.258175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:10.258719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:10.259255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] PATH_INFO: `/v3/projects/e39e02a653aa43468ca78d715630ccce` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:10.261987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39e02a653aa43468ca78d715630ccce)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:10.266443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:10.398252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39e02a653aa43468ca78d715630ccce', 'request_id': 'req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:10.419858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39e02a653aa43468ca78d715630ccce', 'request_id': 'req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:10.443776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39e02a653aa43468ca78d715630ccce', 'request_id': 'req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:10.476504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] The token cache is being invalidate because project e39e02a653aa43468ca78d715630ccce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:10.477067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:10.479558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c5414cf5-ce02-4fa7-afed-21d56b9b3a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:10.485043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 876/1737] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:10 2022] DELETE /identity/v3/projects/e39e02a653aa43468ca78d715630ccce => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:10.490990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:10.498066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:10.498928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:10.540061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:10.547507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:10.766397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 862/1738] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:10.792942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:10.792942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:10.792942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:10.854808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:10.866688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:10.885461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 877/1739] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:10.892341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:10.946025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c00a7f-dd68-4066-b421-9b1ade671a2e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:10.981716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:10.985385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:10.988464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:10.990552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:10.994794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:10.999482 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.008457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.066919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 863/1740] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:11.070426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.104094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858628f-6c84-4814-869b-ce3beec16271 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:11.115237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:11.117272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.118074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.118771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.120368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.127800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f77694-4338-442c-9524-c1c3b488f21d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.224070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 878/1741] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:11 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:11.228854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.241450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c925c1-3a72-483a-a9b2-c444a3ea93c9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:11.259829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.260422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.260876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.304307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] MFA Rules not processed for user `0ec544bab4b94d5e95eaf793afc0138c`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:11.306174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:11.341816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:11.343829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.344131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.344440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.345269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.349316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.386846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 864/1742] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:11 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:11.391964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.409824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb21aee-4809-4f4e-a537-9cf992956185 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:11.428081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:11.428921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.429212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.429711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.437252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.437252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.451277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 865/1743] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:11.452366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.454425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:11.485819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd075-da14-4d17-be2f-72884363b4da admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:11.497756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:11.501348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.503079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.504887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] PATH_INFO: `/v3/users/b7485a44b66541aaa24ab3b83dbc815d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.518387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7485a44b66541aaa24ab3b83dbc815d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.523148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.559190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 879/1744] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:11.561751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.614291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7485a44b66541aaa24ab3b83dbc815d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:11.616709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7485a44b66541aaa24ab3b83dbc815d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:11.626110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33036810-ff14-4395-a0b0-c33a0dcf0de0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:11.648317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:11.651296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:11.653261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:11.657700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:11.660182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:11.666034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:11.693562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7485a44b66541aaa24ab3b83dbc815d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:11.706846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7485a44b66541aaa24ab3b83dbc815d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:11.708035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-293ac37d-6897-4da9-815e-dc3b6f2e1bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7485a44b66541aaa24ab3b83dbc815d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:11.742634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 880/1745] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:11.754656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:11.762847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 866/1746] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:11 2022] DELETE /identity/v3/users/b7485a44b66541aaa24ab3b83dbc815d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:11.771106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:11.833869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890e132-c2f9-45bc-ae64-2bf63afa8cd5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:12.096866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:12.103674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:12.107885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:12.110569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] PATH_INFO: `/v3/projects/e91a7b40f9c5494ba618b572278c48b1/users/7b7f047c3e0b4846b712cf40b33f8803/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:12.215667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950497e2-2117-42fe-9722-467188ac2664 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:12.216190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950497e2-2117-42fe-9722-467188ac2664 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:12.216951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950497e2-2117-42fe-9722-467188ac2664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:12.221752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91a7b40f9c5494ba618b572278c48b1, user_id=7b7f047c3e0b4846b712cf40b33f8803, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:12.248644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47a09-d3b8-4063-b956-2089dacc6b6d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:12.322733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-950497e2-2117-42fe-9722-467188ac2664 None None] MFA Rules not processed for user `6ae6b80b4cb946208c461caebad57faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:12.325363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-950497e2-2117-42fe-9722-467188ac2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:12.335430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 881/1747] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:11 2022] PUT /identity/v3/projects/e91a7b40f9c5494ba618b572278c48b1/users/7b7f047c3e0b4846b712cf40b33f8803/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:12.344751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:12.345248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:12.345699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:12.463546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] MFA Rules not processed for user `7b7f047c3e0b4846b712cf40b33f8803`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:12.464939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:12.542374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 867/1748] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:12.572252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950497e2-2117-42fe-9722-467188ac2664 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:12.586447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-950497e2-2117-42fe-9722-467188ac2664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:12.703898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 882/1749] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:12.710935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:12.936239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950497e2-2117-42fe-9722-467188ac2664 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:12.957504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:12.958481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:12.969297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:12.970429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] PATH_INFO: `/v3/projects/b84eb0c035234cf5932b7860e40470c0` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:12.976057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84eb0c035234cf5932b7860e40470c0)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:12.996672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:13.024130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81962117-0007-4a07-9bbc-93e29b4bc947 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:13.039034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:13.040528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:13.041079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:13.041585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:13.043156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:13.048694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:13.147497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 883/1750] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:12 2022] POST /identity/v3/projects => generated 365 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:13.154616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:13.192494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84eb0c035234cf5932b7860e40470c0', 'request_id': 'req-1f4b53ec-f624-43e4-9f83-f0feb4170f44'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.232628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84eb0c035234cf5932b7860e40470c0', 'request_id': 'req-1f4b53ec-f624-43e4-9f83-f0feb4170f44'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.247833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84eb0c035234cf5932b7860e40470c0', 'request_id': 'req-1f4b53ec-f624-43e4-9f83-f0feb4170f44'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.284601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] The token cache is being invalidate because project b84eb0c035234cf5932b7860e40470c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:13.285382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.287620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.293424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 868/1751] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:12 2022] DELETE /identity/v3/projects/b84eb0c035234cf5932b7860e40470c0 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:13.313378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:13.322877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:13.526221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9d232-f847-4619-a102-5d31fcd0a558 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:13.538147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:13.542106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:13.542482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:13.544451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:13.546579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:13.553817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:13.561708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b53ec-f624-43e4-9f83-f0feb4170f44 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:13.570387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:13.572063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:13.573566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:13.574058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] PATH_INFO: `/v3/users/091ee3f2f3b04d9ebe72510c448ae6f8` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:13.575799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] RBAC: Authorizing `identity:delete_user(user_id=091ee3f2f3b04d9ebe72510c448ae6f8)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:13.578823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:13.635987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 884/1752] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:13 2022] POST /identity/v3/users => generated 289 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:13.637548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:13.640694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:13.664596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091ee3f2f3b04d9ebe72510c448ae6f8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.665881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091ee3f2f3b04d9ebe72510c448ae6f8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.688450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091ee3f2f3b04d9ebe72510c448ae6f8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.700272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82875165-4f35-4fff-8c40-44089039794c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:13.712332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091ee3f2f3b04d9ebe72510c448ae6f8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.714409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091ee3f2f3b04d9ebe72510c448ae6f8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:13.731314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:13.735277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:13.735578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:13.736006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:13.739053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:13.740965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:13.759290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 869/1753] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:13 2022] DELETE /identity/v3/users/091ee3f2f3b04d9ebe72510c448ae6f8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:13.794778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 885/1754] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:13.796514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:13.798269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:14.064087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81afc81-2c8b-4564-ae0c-99cded87499c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:14.093773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:14.099251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:14.100653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:14.101552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] PATH_INFO: `/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1/users/af8f9e27793f41a8933f512dfb1228f4/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:14.163014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd90b5a9b5448fb937be8ac60e73ed1, user_id=af8f9e27793f41a8933f512dfb1228f4, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:14.182761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:14.269836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 870/1755] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:13 2022] PUT /identity/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1/users/af8f9e27793f41a8933f512dfb1228f4/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:14.276234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:14.318075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b54dd-fbd1-455d-8d08-3bf2a576bb8d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:14.355409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:14.358169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:14.561145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d3f77-6e2b-484a-917d-500450d2a098 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:14.568033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:14.569286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:14.569576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:14.569896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] PATH_INFO: `/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:14.571436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7a8c39aa0b42b3b1a794153d4cce10)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:14.573533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:14.657971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:14.658960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:14.659452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:14.660016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:14.665246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:14.668467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:14.683652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7a8c39aa0b42b3b1a794153d4cce10', 'request_id': 'req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:14.702073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7a8c39aa0b42b3b1a794153d4cce10', 'request_id': 'req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:14.737859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7a8c39aa0b42b3b1a794153d4cce10', 'request_id': 'req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:14.777519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 886/1756] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:14.779546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:14.802741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] The token cache is being invalidate because project 6e7a8c39aa0b42b3b1a794153d4cce10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:14.804132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:14.805526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4a307437-1194-4eb1-9e3a-4f3f7cbec3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:14.826331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 871/1757] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:14 2022] DELETE /identity/v3/projects/6e7a8c39aa0b42b3b1a794153d4cce10 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:14.826331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e49c-1ced-4989-8801-2dc9de596d4c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:14.826331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e49c-1ced-4989-8801-2dc9de596d4c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:14.826828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518e49c-1ced-4989-8801-2dc9de596d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:14.836639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845ba8a-0519-45e1-badc-d91a3d90daaa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:14.913452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6518e49c-1ced-4989-8801-2dc9de596d4c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:14.915554 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6518e49c-1ced-4989-8801-2dc9de596d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:15.103225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:15.105187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.106087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.106866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] PATH_INFO: `/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1/users/af8f9e27793f41a8933f512dfb1228f4/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.113787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd90b5a9b5448fb937be8ac60e73ed1, user_id=af8f9e27793f41a8933f512dfb1228f4, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:15.122761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e44f5-2f3a-4d90-a197-89b640d74e35 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:15.190666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 887/1758] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:14 2022] PUT /identity/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1/users/af8f9e27793f41a8933f512dfb1228f4/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:15.195448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12abd8-507d-4868-8658-a74e842edeab None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.196055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12abd8-507d-4868-8658-a74e842edeab None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.196601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12abd8-507d-4868-8658-a74e842edeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.224419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 872/1759] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:15.227741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df07d-04e9-4033-8b22-a6a1109a5b35 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.228247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df07d-04e9-4033-8b22-a6a1109a5b35 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.228748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df07d-04e9-4033-8b22-a6a1109a5b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.316589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d69df07d-04e9-4033-8b22-a6a1109a5b35 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:15.322811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d69df07d-04e9-4033-8b22-a6a1109a5b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:15.329842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-aa12abd8-507d-4868-8658-a74e842edeab None None] MFA Rules not processed for user `af8f9e27793f41a8933f512dfb1228f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:15.337704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-aa12abd8-507d-4868-8658-a74e842edeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:15.569261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 888/1760] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:15.572459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.573041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.573451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.576195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 889/1761] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:20:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:20:15.598251 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:15.600339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:15.648651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 873/1762] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:15.652074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.653238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.654386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.737132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:15.741658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:15.776075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ec40d-22c3-444c-9ff2-05bd98bfbc5d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:15.786949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:15.787637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:15.787937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:15.788254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:15.812815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:15.818694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:15.927683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 890/1763] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:15.943962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.039688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e61f6-1e49-407d-ad8d-a9619b2554f8 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.063996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.066285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.066916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.067410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.068711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:16.069278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.073645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.129888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 891/1764] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:16.131979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.161944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172f2f2-bcdf-4871-8e31-100a10673d96 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.165124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 874/1765] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:16.180930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.187643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.191427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.192516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.193327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.195538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.200415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.209952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84338f55-48b3-4c06-8f8d-cd58fce0269c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.218350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.219731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.220323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.221578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.226666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:16.296834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 892/1766] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:16 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:16.304286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.405381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.406916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.424351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 875/1767] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:16.560398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1120c-6f3a-49e2-9768-bd26ee89a1a7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.575746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.576798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.591729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.593121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.594561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.599303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.661829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 893/1768] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:16 2022] POST /identity/v3/users => generated 291 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:16.663200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.684237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d8081-11db-464b-b84c-7930f14705e1 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.697647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.698373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.698667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.698956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.699742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.701613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.722131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 876/1769] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:16.727057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.742921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6200c-b916-4b2b-a3be-64c8f99c8da6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.764960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.766452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.766888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.767205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.768686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.772328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7657-3853-4a10-bbe3-44e81f39a080 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.789238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 894/1770] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:16.795496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:16.811130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4756-785a-4f00-b92e-9908e4d6257b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:16.831745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:16.834032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.834032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.834194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] PATH_INFO: `/v3/projects/f5d736d0921f48a0ac265486b8d334f3/users/c5d2a45a22e24367aa8a22adfee3ee87/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:16.875437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d736d0921f48a0ac265486b8d334f3, user_id=c5d2a45a22e24367aa8a22adfee3ee87, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:16.882193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:16.915845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 877/1771] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:16 2022] PUT /identity/v3/projects/f5d736d0921f48a0ac265486b8d334f3/users/c5d2a45a22e24367aa8a22adfee3ee87/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:16.938485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:16.939018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:16.939988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:17.008701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] MFA Rules not processed for user `c5d2a45a22e24367aa8a22adfee3ee87`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:17.011943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:17.171228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 895/1772] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:17.182501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:17.349690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:17.353412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:17.481641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8bdd9-df50-445d-8194-6bdbdcaaf16b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:17.495156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:17.495763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:17.496050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:17.496333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:17.497117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:17.499453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:17.561414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 878/1773] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:17 2022] POST /identity/v3/projects => generated 381 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:17.562709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:17.599884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90fb3e1-35b3-4452-9fd5-8eb3d968bd2f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:17.777378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0275ec7-1e11-4597-9364-077e385c8496 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:17.813964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:17.815839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:17.817718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:17.818918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:17.821436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:17.836738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:17.838420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:17.841536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:17.841726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:17.842053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:17.884176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:17.888288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:17.918498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 896/1774] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:17.927367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:17.952052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 879/1775] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:17 2022] POST /identity/v3/users => generated 297 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:17.958027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0c66a-7577-4ce0-a499-c001580f7d96 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:17.988448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:17.990100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:17.990479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:17.991496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:17.992254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:17.994431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:18.058812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 897/1776] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:18.063651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:18.096473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef9cf0-3230-483f-8b2f-20ae951330bc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:18.106396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:18.108861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:18.109765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:18.110465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] PATH_INFO: `/v3/projects/21c5a442e59e4f4584857ddbed5c371c/users/c9967d79b6ca470bbfbb34f77fc25573/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:18.149061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c5a442e59e4f4584857ddbed5c371c, user_id=c9967d79b6ca470bbfbb34f77fc25573, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:18.162377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:18.210772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 880/1777] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:18 2022] PUT /identity/v3/projects/21c5a442e59e4f4584857ddbed5c371c/users/c9967d79b6ca470bbfbb34f77fc25573/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:18.230468 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:18.253211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0224095-38ef-4e52-ae3c-e0c4c20e5986 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:18.457358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:18.458944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:18.459482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:18.459970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:18.461982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:18.466620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba1610-d4b3-45b0-8424-b82883e00a47 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:18.506793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 898/1778] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:18.520933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:18.542249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec72102-94d8-42ca-82fe-1846d269c9e7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:18.551441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:18.553543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:18.554293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:18.555018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] PATH_INFO: `/v3/projects/21c5a442e59e4f4584857ddbed5c371c/users/c9967d79b6ca470bbfbb34f77fc25573/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:18.559617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c5a442e59e4f4584857ddbed5c371c, user_id=c9967d79b6ca470bbfbb34f77fc25573, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:18.566470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:18.602392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 881/1779] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:18 2022] PUT /identity/v3/projects/21c5a442e59e4f4584857ddbed5c371c/users/c9967d79b6ca470bbfbb34f77fc25573/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:18.613721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:18.614592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:18.614592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:18.705960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] MFA Rules not processed for user `c9967d79b6ca470bbfbb34f77fc25573`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:18.711613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:18.970395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 899/1780] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:18.992750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:19.126670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb872b6c-a572-43ab-8f73-b7067a5d046c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:19.133773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:19.135154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:19.135685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:19.136200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:19.158695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:19.163100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:19.187787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 882/1781] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:19.430754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:19.459539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490999-fad2-4a5f-bd12-38cef46b9699 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:19.483783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:19.485107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:19.485884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:19.492943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:19.717411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:19.722473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892509b-be11-441f-9342-2dad09da1060 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:19.744835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 900/1782] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:20.979701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:20.982921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:21.125969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c1084-1af2-4295-b803-7e8c965457e0 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:21.136311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:21.138427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:21.138846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:21.139321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] PATH_INFO: `/v3/users/7b7f047c3e0b4846b712cf40b33f8803` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:21.141653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7f047c3e0b4846b712cf40b33f8803)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:21.145402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:21.256372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7f047c3e0b4846b712cf40b33f8803'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:21.257751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7f047c3e0b4846b712cf40b33f8803'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:21.304540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7f047c3e0b4846b712cf40b33f8803'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:21.327842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7f047c3e0b4846b712cf40b33f8803'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:21.332123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7f047c3e0b4846b712cf40b33f8803'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:21.372038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 883/1783] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:20 2022] DELETE /identity/v3/users/7b7f047c3e0b4846b712cf40b33f8803 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:21.381183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:21.381856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:21.382320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:21.423123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:21.429879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:21.609358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 901/1784] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:21.654504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:21.660545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:21.883872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703392d0-ba3b-40a4-97e6-e171041f42d8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:21.890549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:21.894117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:21.894357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:21.894645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:21.911866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:21.913820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:21.927179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 884/1785] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:22.868020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:22.870474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:22.905239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82860e91-4500-47ae-b348-fadda93941e2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:22.917768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:22.920044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:22.921036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:22.922412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] PATH_INFO: `/v3/projects/e91a7b40f9c5494ba618b572278c48b1` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:22.926586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91a7b40f9c5494ba618b572278c48b1)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:22.931367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:23.104075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91a7b40f9c5494ba618b572278c48b1', 'request_id': 'req-516317f3-f6af-4c97-82b6-b1be84610ec4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.121612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91a7b40f9c5494ba618b572278c48b1', 'request_id': 'req-516317f3-f6af-4c97-82b6-b1be84610ec4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.140610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91a7b40f9c5494ba618b572278c48b1', 'request_id': 'req-516317f3-f6af-4c97-82b6-b1be84610ec4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.184954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] The token cache is being invalidate because project e91a7b40f9c5494ba618b572278c48b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:23.185588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.186767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.190407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 902/1786] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:22 2022] DELETE /identity/v3/projects/e91a7b40f9c5494ba618b572278c48b1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:23.196785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:23.214651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511d37-4f34-43b5-976b-68c50600eb93 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:23.377407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:23.378702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:23.379169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:23.379609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] PATH_INFO: `/v3/users/af8f9e27793f41a8933f512dfb1228f4` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:23.389794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8f9e27793f41a8933f512dfb1228f4)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:23.392157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:23.474424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8f9e27793f41a8933f512dfb1228f4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.476303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8f9e27793f41a8933f512dfb1228f4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.507431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8f9e27793f41a8933f512dfb1228f4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.516662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8f9e27793f41a8933f512dfb1228f4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.517525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2de542de-d3f3-4403-b1e5-eb1663a33c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8f9e27793f41a8933f512dfb1228f4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:23.561176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 885/1787] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:23 2022] DELETE /identity/v3/users/af8f9e27793f41a8933f512dfb1228f4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:24.339629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:24.341981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:24.375287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516317f3-f6af-4c97-82b6-b1be84610ec4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:24.495621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:24.497135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:24.497823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:24.498255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] PATH_INFO: `/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:24.500647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd90b5a9b5448fb937be8ac60e73ed1)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:24.504166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:24.592097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd90b5a9b5448fb937be8ac60e73ed1', 'request_id': 'req-d28cbd3f-46a5-4477-8be1-fa0975036905'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:24.610874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd90b5a9b5448fb937be8ac60e73ed1', 'request_id': 'req-d28cbd3f-46a5-4477-8be1-fa0975036905'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:24.638314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd90b5a9b5448fb937be8ac60e73ed1', 'request_id': 'req-d28cbd3f-46a5-4477-8be1-fa0975036905'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:24.687502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] The token cache is being invalidate because project 5fd90b5a9b5448fb937be8ac60e73ed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:24.687906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:24.690912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d28cbd3f-46a5-4477-8be1-fa0975036905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:24.694481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 903/1788] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:24 2022] DELETE /identity/v3/projects/5fd90b5a9b5448fb937be8ac60e73ed1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:24.704019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:24.706908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:24.707743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:24.759023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:24.761504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:24.893114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 886/1789] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:24.897892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:24.898190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:24.898483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:24.926954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:24.928248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:24.938879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 904/1790] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:24.945371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:24.967154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0bab1-7b80-4d72-91c1-cd52cc635bcf None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:24.978143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:24.979418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:24.979910 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:24.980705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:24.982529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:24.983051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:24.987270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.007866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 887/1791] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:25.014265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:25.027738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911323e-2912-4a47-88a8-06dbd8179cd0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:25.034984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:25.035792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.036133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.036398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.037102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:25.039287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.088989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 905/1792] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:25 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:25.093538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:25.116188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1247-c1e0-401c-858e-ccda8db90a36 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:25.202825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:25.203731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.204392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.205270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.206551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:25.211745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.259234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 888/1793] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:25 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:25.262230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:25.309332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2358c9-75f6-4ef3-a760-56da00881718 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:25.332183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:25.335779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.336283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.336768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.338206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:25.344493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.376737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 906/1794] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:25.383212 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:25.395863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc663e-1d64-4a15-bf3c-ab2b03770bbd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:25.426364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:25.429167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.435348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.437127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.440450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:25.449733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70125a-46a6-4f57-acdc-0042bc4acb27 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.489384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 889/1795] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:25.489768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:25.504226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ee7b4-2b93-40b8-9c7a-fd133a21991a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:25.521624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:25.522931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.522931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.523263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] PATH_INFO: `/v3/projects/149ab4fbfa674bccbcceeee252a0d336/users/da49c126d8664b1891f472c5ab79da23/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.563132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149ab4fbfa674bccbcceeee252a0d336, user_id=da49c126d8664b1891f472c5ab79da23, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:25.567256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:25.621880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 907/1796] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:25 2022] PUT /identity/v3/projects/149ab4fbfa674bccbcceeee252a0d336/users/da49c126d8664b1891f472c5ab79da23/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:25.648429 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:25.649092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:25.649808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:25.780744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] MFA Rules not processed for user `da49c126d8664b1891f472c5ab79da23`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:25.782067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:26.034393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 890/1797] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:26.034792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.216082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e469b7-e303-49ed-bf08-f0a3597a17a0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.226180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.227209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.227607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.227984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.229073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.231313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.279973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 908/1798] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:26 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:26.284830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.305627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843db0dc-751e-4c91-b466-524feb6e5638 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.402277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.402983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.403276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.403557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.404299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.406392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.445035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.446140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 891/1799] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:26 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:26.457149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4610c0-fa85-468b-b26b-1d1eca427ac1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.464322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.465427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.465914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.466387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.467372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.469593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.496194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 909/1800] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:26.497886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.511690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6164f8-6a95-4de0-88b6-518e96d6634e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.523193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.524402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.524874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.525353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] PATH_INFO: `/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770/users/280679d94e724c3ab525d9feb25c2f08/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.545202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ebc62b4a8e422ca13e8b7dff3cd770, user_id=280679d94e724c3ab525d9feb25c2f08, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.548018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.565734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 892/1801] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:26 2022] PUT /identity/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770/users/280679d94e724c3ab525d9feb25c2f08/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:26.569945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.581803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c3868-085c-42a4-b761-f93745cffc58 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.683078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.684374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.685008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.685578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.687032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.690994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb033de-44d5-470c-b71b-5266db8e3dfe admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.713823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 910/1802] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:26.719140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.739486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa803c-1c1a-45d4-b7a8-a35ae7ff84c7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:26.744753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:26.745711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.745998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.746276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] PATH_INFO: `/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770/users/280679d94e724c3ab525d9feb25c2f08/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.750870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ebc62b4a8e422ca13e8b7dff3cd770, user_id=280679d94e724c3ab525d9feb25c2f08, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:26.757198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:26.770895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 893/1803] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:26 2022] PUT /identity/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770/users/280679d94e724c3ab525d9feb25c2f08/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:26.782830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:26.783377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:26.783787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:26.817847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] MFA Rules not processed for user `280679d94e724c3ab525d9feb25c2f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:26.819200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:26.923320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 911/1804] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:26.937682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:26.940476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:27.067414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff5a8f-79b5-4015-9346-d196dee44f64 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:27.073914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:27.075187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:27.075759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:27.076353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:27.094712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:27.099280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:27.120366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 894/1805] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:27.187707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:27.198819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b932ac-abae-4576-8ae4-629f08f4d0dc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:27.206695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:27.207350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:27.207624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:27.208127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:27.322318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:27.325426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d820d-ea7f-485a-aa24-2145c06312ae service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:27.348411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 912/1806] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:31.354469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:31.460885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2a929-294e-4d80-881d-a932ce5b845e service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:31.474527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:31.476152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:31.476721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:31.477366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] PATH_INFO: `/v3/users/da49c126d8664b1891f472c5ab79da23` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:31.484937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da49c126d8664b1891f472c5ab79da23)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:31.491441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:31.620043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da49c126d8664b1891f472c5ab79da23'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:31.622615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da49c126d8664b1891f472c5ab79da23'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:31.654629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da49c126d8664b1891f472c5ab79da23'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:31.683337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da49c126d8664b1891f472c5ab79da23'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:31.683337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da49c126d8664b1891f472c5ab79da23'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:31.717074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 895/1807] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:31 2022] DELETE /identity/v3/users/da49c126d8664b1891f472c5ab79da23 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:31.724049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:31.724864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:31.725053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:31.778218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:31.780753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:31.936241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 913/1808] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:31.974469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:31.979480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:32.137364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27cefe-1b37-4bb1-9e9d-54cbf1ef5162 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:32.145258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:32.146071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:32.146414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:32.146797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:32.177998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:32.182278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:32.204211 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 896/1809] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:32.929484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:32.931841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:32.982912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4712f-0130-42c5-86ca-98c43c299188 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:33.003399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:33.008222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:33.008718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:33.009222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] PATH_INFO: `/v3/projects/149ab4fbfa674bccbcceeee252a0d336` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:33.012859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] RBAC: Authorizing `identity:delete_project(project_id=149ab4fbfa674bccbcceeee252a0d336)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:33.023352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:33.126154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149ab4fbfa674bccbcceeee252a0d336', 'request_id': 'req-9e6a5c2a-6444-49a1-affc-e6f07568762e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.148811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149ab4fbfa674bccbcceeee252a0d336', 'request_id': 'req-9e6a5c2a-6444-49a1-affc-e6f07568762e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.149793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:33.151750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:33.169808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149ab4fbfa674bccbcceeee252a0d336', 'request_id': 'req-9e6a5c2a-6444-49a1-affc-e6f07568762e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.170980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bcf73-5f30-40e0-854c-a09a0e9be17a service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:33.192299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] The token cache is being invalidate because project 149ab4fbfa674bccbcceeee252a0d336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:33.192600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.193490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.200401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 914/1810] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:32 2022] DELETE /identity/v3/projects/149ab4fbfa674bccbcceeee252a0d336 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:33.201961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:33.206566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:33.381193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:33.396174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:33.396658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:33.396837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] PATH_INFO: `/v3/users/13f6ad9af42f43d8ab98a1a3c3ed7fda` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:33.401134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f6ad9af42f43d8ab98a1a3c3ed7fda)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:33.405549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:33.441716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a5c2a-6444-49a1-affc-e6f07568762e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:33.463961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:33.466863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:33.468594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:33.469078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] PATH_INFO: `/v3/users/280679d94e724c3ab525d9feb25c2f08` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:33.472597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=280679d94e724c3ab525d9feb25c2f08)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:33.483588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:33.541158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f6ad9af42f43d8ab98a1a3c3ed7fda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.542780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f6ad9af42f43d8ab98a1a3c3ed7fda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.587703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f6ad9af42f43d8ab98a1a3c3ed7fda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.598356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f6ad9af42f43d8ab98a1a3c3ed7fda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.608560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e7bdadae-ab55-4602-91a9-f91031743d74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f6ad9af42f43d8ab98a1a3c3ed7fda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.655758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280679d94e724c3ab525d9feb25c2f08'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.669459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 897/1811] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:33 2022] DELETE /identity/v3/users/13f6ad9af42f43d8ab98a1a3c3ed7fda => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:33.675635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:33.675858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:33.677556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:33.716341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280679d94e724c3ab525d9feb25c2f08'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.718556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280679d94e724c3ab525d9feb25c2f08'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.736870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:33.739494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:33.746868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280679d94e724c3ab525d9feb25c2f08'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.771417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280679d94e724c3ab525d9feb25c2f08'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:33.796284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 915/1812] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:33 2022] DELETE /identity/v3/users/280679d94e724c3ab525d9feb25c2f08 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:33.853936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 898/1813] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:33.865001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:33.870711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:34.105152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1b730-448f-4af0-9437-7f4b1199a4b5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:34.130996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:34.132206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.133640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.134182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.301134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:34.302812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ffe30-6ced-4cef-903a-e5db89c4d469 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:34.317947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 916/1814] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:34.398768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:34.402578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:34.428625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38996-cc7a-43dd-973f-5001ba92570f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:34.439381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:34.442477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.443411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.444179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] PATH_INFO: `/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.446746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ebc62b4a8e422ca13e8b7dff3cd770)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:34.452504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:34.539513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ebc62b4a8e422ca13e8b7dff3cd770', 'request_id': 'req-6d8bd91c-6fd5-413a-8b09-547daec723f1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:34.551755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ebc62b4a8e422ca13e8b7dff3cd770', 'request_id': 'req-6d8bd91c-6fd5-413a-8b09-547daec723f1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:34.566838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ebc62b4a8e422ca13e8b7dff3cd770', 'request_id': 'req-6d8bd91c-6fd5-413a-8b09-547daec723f1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:34.583731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] The token cache is being invalidate because project e0ebc62b4a8e422ca13e8b7dff3cd770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:34.584476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:34.585643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6d8bd91c-6fd5-413a-8b09-547daec723f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:34.588016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 899/1815] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:34 2022] DELETE /identity/v3/projects/e0ebc62b4a8e422ca13e8b7dff3cd770 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:34.592921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.594051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.594051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.624506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:34.625787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:34.759204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 917/1816] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:34.772069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.772445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.772856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.820861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:34.824132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:34.840398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:34.841956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:34.854721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 900/1817] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:34.859846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c823f-ce58-4576-ba47-1555cd443648 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:34.863744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:34.872080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:34.873009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.875656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.876021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] PATH_INFO: `/v3/projects/45220fca5ae1406d814191d5246511fa` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.879925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45220fca5ae1406d814191d5246511fa)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:34.885678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:34.889507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233159-dfa0-41c5-ad0b-65cb051dbec0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:34.900712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:34.901954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.902450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.904161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.904977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:34.905738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:34.912613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:34.943902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 901/1818] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:34.953022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:34.977026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17252c-dd75-4301-8904-25ebc3d1f86e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:34.989142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:34.990069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:34.990507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:34.990929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:34.991846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:34.994169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.035641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 902/1819] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:34 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:35.042047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.057277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45220fca5ae1406d814191d5246511fa', 'request_id': 'req-3bd7931f-d27b-4b05-8222-d19fbf6d3851'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.078610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45220fca5ae1406d814191d5246511fa', 'request_id': 'req-3bd7931f-d27b-4b05-8222-d19fbf6d3851'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.151306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45220fca5ae1406d814191d5246511fa', 'request_id': 'req-3bd7931f-d27b-4b05-8222-d19fbf6d3851'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.191836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] The token cache is being invalidate because project 45220fca5ae1406d814191d5246511fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:35.192390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.193706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3bd7931f-d27b-4b05-8222-d19fbf6d3851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.196990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 918/1820] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:34 2022] DELETE /identity/v3/projects/45220fca5ae1406d814191d5246511fa => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:35.206004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.206844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.207910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.222118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd907c2-c533-4885-a005-dea0dcd619c2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.237887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.238514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.238820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.239099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.240284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.245433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f733922-de71-407e-8759-f40c22866b23 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.283598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:35.287855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.318420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 903/1821] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:35.320740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 919/1822] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:35.325583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.327099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.328321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.329882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.331215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.358722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155631f4-27c2-401b-8bca-1e70a24c8bd7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.369891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.371725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.372705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.373760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.376627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.381861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.416366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 920/1823] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:35.421471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.447528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8b6f5-5d43-4c78-8c6e-a11dae4a142a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.456841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:35.462730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.495714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.496471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 904/1824] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:35.504744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.508642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.510935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.511479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.527493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.537266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.552165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce4f7c-8ae8-4ebb-9a95-69fcfc7b30b9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.569574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 921/1825] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:35.572095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.575903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.592197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.593385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.593867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.594324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.596223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:35.596769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.605456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.608888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbc73-138d-4522-b1bb-b809e26c8a99 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.628015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.628506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.628788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.629121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] PATH_INFO: `/v3/users/c5d2a45a22e24367aa8a22adfee3ee87` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.633766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d2a45a22e24367aa8a22adfee3ee87)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.635965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.650050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 905/1826] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:20:35.653351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.684180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9c4ca-2580-4bab-98fc-60188222ee49 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.698622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:35.699867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.701738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.702313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] PATH_INFO: `/v3/projects/46ba747475264c709aeb5589a3507c3e/users/532509e7135b4d24b8b5e7f8033f362a/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.786666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d2a45a22e24367aa8a22adfee3ee87'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.791106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46ba747475264c709aeb5589a3507c3e, user_id=532509e7135b4d24b8b5e7f8033f362a, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:35.794240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:35.814597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d2a45a22e24367aa8a22adfee3ee87'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.815734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d2a45a22e24367aa8a22adfee3ee87'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.826931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d2a45a22e24367aa8a22adfee3ee87'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.830464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 906/1827] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:35 2022] PUT /identity/v3/projects/46ba747475264c709aeb5589a3507c3e/users/532509e7135b4d24b8b5e7f8033f362a/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:35.835663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:35.838986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.844289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d57a5d14-22ab-474c-b32c-9a5902af1da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d2a45a22e24367aa8a22adfee3ee87'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:35.853482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 922/1828] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:35 2022] DELETE /identity/v3/users/c5d2a45a22e24367aa8a22adfee3ee87 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:35.855625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c60d62-9071-432d-a353-d4ae913caf00 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:35.855987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c60d62-9071-432d-a353-d4ae913caf00 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:35.856337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c60d62-9071-432d-a353-d4ae913caf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:35.901600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-57c60d62-9071-432d-a353-d4ae913caf00 None None] MFA Rules not processed for user `532509e7135b4d24b8b5e7f8033f362a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:35.904949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-57c60d62-9071-432d-a353-d4ae913caf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:35.972383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80782495-9a2a-45a6-a6ec-9e7dabb64e05 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:35.998640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 923/1829] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:36.000331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.000624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.000931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.021191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:36.022320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:36.100479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.101929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.102439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.102942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.103720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 924/1830] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:36.104326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.104499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.108818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:36.113584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.122034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8701-46c9-46b5-8607-dc480d2d3444 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.128222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.128946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.129198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.129469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.130182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.132119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.149088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 907/1831] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:35 2022] POST /identity/v3/projects => generated 359 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:36.149315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.151961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:36.163949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 925/1832] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:36 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:36.165631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.244009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ba42a-04f0-4b86-a0a1-8b54e0eaafdf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.255240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.256449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.257131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.257576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.259229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.263230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a52f5-c50d-4233-8e75-acc47721b84b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.263489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.306208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 926/1833] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:36 2022] POST /identity/v3/users => generated 280 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:36.308074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.328160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7911ee-1e8b-4a6d-abf3-e5151b5a0aa9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.330924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.331560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.332048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.332336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.338062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.339344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.339726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.340099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.340937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.343311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.349453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.352473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.365899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 908/1834] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:36.367069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.369146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 927/1835] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:36 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:36.372663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.384199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026e8ec-db2b-4563-b7a2-c7839be205cf service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.387401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bf95c-76a9-4931-be02-073f7d3170aa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.391543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.392709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.393159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.393559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.394672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.395694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.396849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.397029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.397490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.398040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.399671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.401363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.417464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 909/1836] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:36.418865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 928/1837] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:36.422468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.426146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.439620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22302d73-757d-431a-980a-d3e475488c8e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.443914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eccd08-8ee8-40ec-942a-071da9a0a42f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.446773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.447988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.448308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.448773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] PATH_INFO: `/v3/projects/6f639f6b00714934b16d50c1fb81836d/users/67386305a4ae43d48bec102b493bfc32/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.452311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.453376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.453827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.455943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.457183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.461102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.474583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f639f6b00714934b16d50c1fb81836d, user_id=67386305a4ae43d48bec102b493bfc32, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.478465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.482140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 910/1838] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:36.497048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.503743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 929/1839] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:36 2022] PUT /identity/v3/projects/6f639f6b00714934b16d50c1fb81836d/users/67386305a4ae43d48bec102b493bfc32/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:36.508364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.515499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ae541-6cc4-4c35-a7de-20cdca9e456e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.640172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d679d-aa09-4cc8-8066-247678753c50 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.662880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.663652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.663941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.664388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.668882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.677897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.702596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.705822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.706324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.710288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] PATH_INFO: `/v3/projects/19028a500c384f69a5fd2fcf36714014/users/4fe702a840d24e47986a3f3d3779c927/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.731775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 930/1840] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:36.737090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:36.771222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19028a500c384f69a5fd2fcf36714014, user_id=4fe702a840d24e47986a3f3d3779c927, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.772795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664a9e0-ccc3-4e60-b0d9-5dfcbc92741a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:36.779648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d571f-3e12-4079-a709-5f3ef82475e2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.791717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:36.793981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.794814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.795005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] PATH_INFO: `/v3/projects/6f639f6b00714934b16d50c1fb81836d/users/67386305a4ae43d48bec102b493bfc32/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.799539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f639f6b00714934b16d50c1fb81836d, user_id=67386305a4ae43d48bec102b493bfc32, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:36.805093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a6202-fbbd-43c4-98f9-79c77f838d91 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:36.812314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 911/1841] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:36 2022] PUT /identity/v3/projects/19028a500c384f69a5fd2fcf36714014/users/4fe702a840d24e47986a3f3d3779c927/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:36.824645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.824970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.825232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.842075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 931/1842] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:36 2022] PUT /identity/v3/projects/6f639f6b00714934b16d50c1fb81836d/users/67386305a4ae43d48bec102b493bfc32/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:36.858770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] MFA Rules not processed for user `4fe702a840d24e47986a3f3d3779c927`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:36.859318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:36.860191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:36.861489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:36.865945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:36.923780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] MFA Rules not processed for user `67386305a4ae43d48bec102b493bfc32`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:36.925222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:36.988182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 912/1843] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:37.035935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.038048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.094811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 932/1844] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:37.097919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.100030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.165065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494001-29b4-4e59-adb6-4106aa077a1c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.171183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.172336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.172816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.173403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.187810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.189501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.200254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 913/1845] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:37.201274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.202682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.221018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2881c98-8dd2-4aab-a44b-bb22ceb9a9f1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.226406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb4530-1dff-457d-97d8-7d4bc8a838e6 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.229911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.231437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.231940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.232435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] PATH_INFO: `/v3/projects/f5d736d0921f48a0ac265486b8d334f3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.233517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.234633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.235019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d736d0921f48a0ac265486b8d334f3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.235118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.236218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.239641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.258746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.260242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.271349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 914/1846] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:37.272371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.284934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7428a5-48a6-4612-95f7-897f4465a83a service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.291256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.291980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.292471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.292707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] PATH_INFO: `/v3/users/4fe702a840d24e47986a3f3d3779c927` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.294179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe702a840d24e47986a3f3d3779c927)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.296401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.333120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d736d0921f48a0ac265486b8d334f3', 'request_id': 'req-5d215076-5ded-4153-8bb0-91af3abbc000'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.341107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d736d0921f48a0ac265486b8d334f3', 'request_id': 'req-5d215076-5ded-4153-8bb0-91af3abbc000'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.354576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d736d0921f48a0ac265486b8d334f3', 'request_id': 'req-5d215076-5ded-4153-8bb0-91af3abbc000'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.367149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe702a840d24e47986a3f3d3779c927'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.368095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe702a840d24e47986a3f3d3779c927'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.376939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] The token cache is being invalidate because project f5d736d0921f48a0ac265486b8d334f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:37.377482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.378684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.381743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 933/1847] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:37 2022] DELETE /identity/v3/projects/f5d736d0921f48a0ac265486b8d334f3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:37.383255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.385691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.387265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe702a840d24e47986a3f3d3779c927'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.396997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe702a840d24e47986a3f3d3779c927'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.397975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe702a840d24e47986a3f3d3779c927'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.419219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 915/1848] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:37 2022] DELETE /identity/v3/users/4fe702a840d24e47986a3f3d3779c927 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:37.420708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.423260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.476275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d215076-5ded-4153-8bb0-91af3abbc000 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.545153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407c7e3-34fc-4d81-9a18-74a7ec87c19f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:37.556988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.558255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.558725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.559324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] PATH_INFO: `/v3/users/c9967d79b6ca470bbfbb34f77fc25573` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.561601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9967d79b6ca470bbfbb34f77fc25573)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.565560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:37.566105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.566617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.566903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.567183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] PATH_INFO: `/v3/users/532509e7135b4d24b8b5e7f8033f362a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.568572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532509e7135b4d24b8b5e7f8033f362a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:37.570851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:37.645423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532509e7135b4d24b8b5e7f8033f362a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.658309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9967d79b6ca470bbfbb34f77fc25573'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.659196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9967d79b6ca470bbfbb34f77fc25573'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.671569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532509e7135b4d24b8b5e7f8033f362a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.672775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532509e7135b4d24b8b5e7f8033f362a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.678450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9967d79b6ca470bbfbb34f77fc25573'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.687772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532509e7135b4d24b8b5e7f8033f362a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.688462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9967d79b6ca470bbfbb34f77fc25573'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.690132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b69452fe-09e8-47fb-8b76-63d655476da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9967d79b6ca470bbfbb34f77fc25573'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.708451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-720b4b4c-f519-47ed-9722-ea83cf9aa101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532509e7135b4d24b8b5e7f8033f362a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:37.715302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 916/1849] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:37 2022] DELETE /identity/v3/users/c9967d79b6ca470bbfbb34f77fc25573 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:37.717972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.718485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.718999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.723457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 934/1850] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:37 2022] DELETE /identity/v3/users/532509e7135b4d24b8b5e7f8033f362a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:37.738746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:37.742551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:37.743790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:37.760071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:37.760356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.798718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:37.801886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.871861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 917/1851] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:37.897539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.899895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:37.958457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 935/1852] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:37.976294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:37.977857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:38.021335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cef06-fdbf-4919-8d03-b43612a207ed None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:38.025478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:38.026155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:38.026459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:38.026734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:38.038688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:38.040361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:38.053404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 918/1853] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:38.118694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76bba6-fd18-4910-a4e9-98ea0b58a72b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:38.126407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:38.127736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:38.128229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:38.128728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:38.149317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:38.152079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:38.175297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 936/1854] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:38.552299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:38.555393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:38.583225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756a74-37e0-4579-82e5-cbf23c854f32 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:38.596124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:38.597675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:38.598283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:38.598925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] PATH_INFO: `/v3/projects/21c5a442e59e4f4584857ddbed5c371c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:38.602356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c5a442e59e4f4584857ddbed5c371c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:38.606771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:38.717990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:38.720657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:38.721644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c5a442e59e4f4584857ddbed5c371c', 'request_id': 'req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:38.755413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c5a442e59e4f4584857ddbed5c371c', 'request_id': 'req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:38.775472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c5a442e59e4f4584857ddbed5c371c', 'request_id': 'req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:38.779315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cfc81-65e3-40d1-94ef-b7dbe2f2d57b service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:38.830507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] The token cache is being invalidate because project 21c5a442e59e4f4584857ddbed5c371c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:38.832699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:38.835219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9b1456e-e2b1-4ba7-b127-b6b3115cf062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:38.838616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 919/1855] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:38 2022] DELETE /identity/v3/projects/21c5a442e59e4f4584857ddbed5c371c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:38.848034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2fb-376b-479e-943d-20a147a110d4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:38.848734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2fb-376b-479e-943d-20a147a110d4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:38.849661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cd2fb-376b-479e-943d-20a147a110d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:38.903153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-208cd2fb-376b-479e-943d-20a147a110d4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:38.905237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-208cd2fb-376b-479e-943d-20a147a110d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:38.932850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:38.937992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:38.938559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:38.940058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] PATH_INFO: `/v3/projects/19028a500c384f69a5fd2fcf36714014` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:38.943980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19028a500c384f69a5fd2fcf36714014)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:38.950062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.014414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 920/1856] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:39.018122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.019018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.019517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.050381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:39.053810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.103026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19028a500c384f69a5fd2fcf36714014', 'request_id': 'req-3decd062-8269-4fc3-b39f-3665c2c909e4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.115683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19028a500c384f69a5fd2fcf36714014', 'request_id': 'req-3decd062-8269-4fc3-b39f-3665c2c909e4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.129221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19028a500c384f69a5fd2fcf36714014', 'request_id': 'req-3decd062-8269-4fc3-b39f-3665c2c909e4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.152504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 921/1857] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:39.159871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.167641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] The token cache is being invalidate because project 19028a500c384f69a5fd2fcf36714014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:39.168149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.169391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3decd062-8269-4fc3-b39f-3665c2c909e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.172206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 937/1858] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:38 2022] DELETE /identity/v3/projects/19028a500c384f69a5fd2fcf36714014 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:20:39.178462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99c12c-deed-4eb1-b440-a5f366416a65 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.181264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19105-3031-4b22-b112-ac98dd9d50c6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.181820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19105-3031-4b22-b112-ac98dd9d50c6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.182328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee19105-3031-4b22-b112-ac98dd9d50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.185164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.185953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.186354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.186702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.187630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:39.188006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.192077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.216990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 922/1859] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:39.217262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6ee19105-3031-4b22-b112-ac98dd9d50c6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:39.218799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.219592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6ee19105-3031-4b22-b112-ac98dd9d50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.222871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.240955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 938/1860] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:39.241180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771a9fa-b987-4d7f-9c10-581426fefc4b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.255962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.256670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.256881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.257092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.257231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.257365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.257719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.258019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.261440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.320452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:39.323089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.339959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 923/1861] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:39.339959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.476292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 939/1862] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:39.477244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.488425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.524636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8caf86-680d-4582-aba9-64db3a48399b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.530696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e915d-e4b6-4948-9ee1-f6c696e8381f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.551088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.553411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.554547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.554547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.555621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.573826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.574568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.576255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.576780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.577218 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] PATH_INFO: `/v3/projects/46ba747475264c709aeb5589a3507c3e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.580175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46ba747475264c709aeb5589a3507c3e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.585110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.607164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 924/1863] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:39.608540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.621411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed296474-b0c7-4c97-9955-ee4a223516b2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.629249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.630410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.630902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.631363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.632331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:39.632848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.634903 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.677488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 925/1864] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:39.679925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.694564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ba747475264c709aeb5589a3507c3e', 'request_id': 'req-c4061815-ecab-4057-9fdf-1a3535142ac8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.708085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e086d-cab9-4b64-8257-8192180f4d28 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.708782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ba747475264c709aeb5589a3507c3e', 'request_id': 'req-c4061815-ecab-4057-9fdf-1a3535142ac8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.729516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ba747475264c709aeb5589a3507c3e', 'request_id': 'req-c4061815-ecab-4057-9fdf-1a3535142ac8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.763655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] The token cache is being invalidate because project 46ba747475264c709aeb5589a3507c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:39.764043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.765608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:39.769745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 940/1865] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:39 2022] DELETE /identity/v3/projects/46ba747475264c709aeb5589a3507c3e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:39.781193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.786955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.936148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.938167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:39.939102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:39.939691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:39.941136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:39.943572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:39.963876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 926/1866] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:39.965815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:39.971802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:39.990810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19df14-17f8-4118-b811-dd8c94060d88 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:39.998527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:39.999935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.000179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.000563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] PATH_INFO: `/v3/users/67386305a4ae43d48bec102b493bfc32` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.002032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4061815-ecab-4057-9fdf-1a3535142ac8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.002251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=67386305a4ae43d48bec102b493bfc32)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.004784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.020138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.020927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.021228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.021505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.022284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.026689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.061154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 941/1867] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:39 2022] POST /identity/v3/projects => generated 367 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:40.062330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.071999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.108376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67386305a4ae43d48bec102b493bfc32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.110300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67386305a4ae43d48bec102b493bfc32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.155425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232137-b46a-43b2-8c2e-0f4ec1906ac3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.162116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.162694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67386305a4ae43d48bec102b493bfc32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.162816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.163075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.163357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.164121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.165904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.184184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67386305a4ae43d48bec102b493bfc32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.185394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67386305a4ae43d48bec102b493bfc32'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.189544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 942/1868] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:40.190699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.205424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.216727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcbe31-77a0-4e13-afe9-569d8bb7a67d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.224589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.225347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.225639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.225917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.226660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.229291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.229755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 927/1869] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:39 2022] DELETE /identity/v3/users/67386305a4ae43d48bec102b493bfc32 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:40.231763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.238047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.263366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 943/1870] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:40 2022] POST /identity/v3/users => generated 284 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:40.268416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.287593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758656a-00a9-4eae-ad40-98dc5a24be29 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.365510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d4cab-ce93-4ab9-830b-40608d1a79eb admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.372464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.375299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.375677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.376340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] PATH_INFO: `/v3/projects/8be82e1187864b8295dc32cee44fb730/users/c8eaca3ab6a54fcb81b01cd7805d7b6d/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.397940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be82e1187864b8295dc32cee44fb730, user_id=c8eaca3ab6a54fcb81b01cd7805d7b6d, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.400469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd25a0-33da-4f95-a517-15f53dab6d9d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.434559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 928/1871] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:40 2022] PUT /identity/v3/projects/8be82e1187864b8295dc32cee44fb730/users/c8eaca3ab6a54fcb81b01cd7805d7b6d/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:40.435983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.436191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.436496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.436748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.438252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.439678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.440424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.442111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.445465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.479191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] MFA Rules not processed for user `c8eaca3ab6a54fcb81b01cd7805d7b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:40.481417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.487386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 944/1872] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:40.493165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.521530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e831-4a09-4219-b31f-c924ccd93a63 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.622159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 929/1873] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:40.628108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.642496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.645033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.645883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.646848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.648806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.652606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.685075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 945/1874] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:40.694272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.721494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0623359-2df1-4505-9b6c-7b10d3f7ba7c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.729944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.732645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.735882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.737127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] PATH_INFO: `/v3/projects/7dbd538edc0341b4ae0f80e57cb71332/users/51dc82438a534759986e05d9a73dfc24/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.739561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea178e-3047-48a7-93dd-16b7ebbf7cbf None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.749377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.750387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.750679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.750953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.755064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.757178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.773898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbd538edc0341b4ae0f80e57cb71332, user_id=51dc82438a534759986e05d9a73dfc24, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.777086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.805172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 930/1875] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:40 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:40.805172 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.805471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 946/1876] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:40 2022] PUT /identity/v3/projects/7dbd538edc0341b4ae0f80e57cb71332/users/51dc82438a534759986e05d9a73dfc24/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:40.807880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.810236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:40.902050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb3145-4604-477d-b838-05bc11565ea4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.902269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd4bb8-c664-4443-b27b-05900bfbee49 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:40.906840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.908164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.908446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.908663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:40.908847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.909458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.909826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.910204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.910576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] PATH_INFO: `/v3/projects/6f639f6b00714934b16d50c1fb81836d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.911439 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e526bc-510b-4242-98f9-4e637a9eb9c4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.912242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f639f6b00714934b16d50c1fb81836d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:40.914595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:40.937538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 947/1877] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:40 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:40.943637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527ce2-ff52-47b3-9c66-a940a2ecdb04 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:40.944101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527ce2-ff52-47b3-9c66-a940a2ecdb04 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:40.944561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527ce2-ff52-47b3-9c66-a940a2ecdb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:40.976018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f639f6b00714934b16d50c1fb81836d', 'request_id': 'req-ccb6110e-1647-4ca3-89e4-e22785b6e656'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.982850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f639f6b00714934b16d50c1fb81836d', 'request_id': 'req-ccb6110e-1647-4ca3-89e4-e22785b6e656'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:40.984926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-17527ce2-ff52-47b3-9c66-a940a2ecdb04 None None] MFA Rules not processed for user `51dc82438a534759986e05d9a73dfc24`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:40.987667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-17527ce2-ff52-47b3-9c66-a940a2ecdb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:40.992374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f639f6b00714934b16d50c1fb81836d', 'request_id': 'req-ccb6110e-1647-4ca3-89e4-e22785b6e656'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:41.006929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] The token cache is being invalidate because project 6f639f6b00714934b16d50c1fb81836d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:41.007220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:41.007945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:41.009696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 931/1878] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:40 2022] DELETE /identity/v3/projects/6f639f6b00714934b16d50c1fb81836d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:41.010495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.011868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.091776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 948/1879] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:41.093315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.093629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.093874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.118214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:41.119472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.124024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6110e-1647-4ca3-89e4-e22785b6e656 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.130225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 949/1880] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:41.131007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.132459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.132750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.133952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.134450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.134942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.136744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.140069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226731f3-6f82-416f-a9b9-fafb5bf84cf5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.159637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 932/1881] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:41.162572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.163578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.164315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.200457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:41.202707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.203930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84609e69-91ef-4892-ad2a-65f3748d3500 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.217111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.217806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.218124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.218481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.221238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 933/1882] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:41.221238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.231279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.232711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88934bcb-ebe6-4731-825e-e61e9e2ab0ff None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.233033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.238925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.241952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.242345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.242514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] PATH_INFO: `/v3/projects/0ead8d66b97d4b68ac06cbab7787f134/users/b6a29a81e8814365b9f57e7686a5edda/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.254358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 950/1883] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:41.258491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.281304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b91d9-eb5c-4050-86b1-40ca123e83f2 service glance] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.301241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ead8d66b97d4b68ac06cbab7787f134, user_id=b6a29a81e8814365b9f57e7686a5edda, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.301241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.302603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.303292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.303605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.303878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.304945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:41.305060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.306885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.325559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 951/1884] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:41.326629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 934/1885] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:41 2022] PUT /identity/v3/projects/0ead8d66b97d4b68ac06cbab7787f134/users/b6a29a81e8814365b9f57e7686a5edda/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:41.331377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.334595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.342774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91801c5b-97ee-4943-ae65-eef7f0a145b6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.438700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc0f0f-1a0f-411c-8b06-f0b74ac2c82c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.444729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.445601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.445888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.446165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.446934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.448744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.462525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 935/1886] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:41.466564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.474301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.475391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.475885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.476392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.478318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.479503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fb5ba-c410-40d4-af98-7c206a25992a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.482752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.486967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.488229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.488868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.489187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] PATH_INFO: `/v3/projects/0ead8d66b97d4b68ac06cbab7787f134/users/b6a29a81e8814365b9f57e7686a5edda/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.492053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ead8d66b97d4b68ac06cbab7787f134, user_id=b6a29a81e8814365b9f57e7686a5edda, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.495350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10302d-8158-4291-954d-945af82ffb43 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.511121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 936/1887] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:41 2022] PUT /identity/v3/projects/0ead8d66b97d4b68ac06cbab7787f134/users/b6a29a81e8814365b9f57e7686a5edda/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:41.530333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.530699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.531113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.549311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 952/1888] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/projects => generated 373 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:41.557910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.607583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] MFA Rules not processed for user `b6a29a81e8814365b9f57e7686a5edda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:41.608857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.686271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56649f7-2000-42cb-8b47-292e27a85265 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.693602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.694296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.694589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.694867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.695651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.697807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.728331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 937/1889] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:41.732953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 953/1890] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:41.738163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.741451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.743807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:41.761118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec6593-0c67-4197-910a-00c314e57b2e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.769993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.771105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.771298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.771610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.772787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.774953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.794127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 938/1891] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:41.796081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.833841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b192828-fe22-41f7-98cf-cba49f03f710 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.842414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.842704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25a6a5-b073-4354-8c70-0724a52b8945 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.843162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.843459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.843857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.844751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.847409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.849453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.850135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.850420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.850697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.863998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.866202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a79b3-fd73-4fcb-a76c-fa2ecef8d9f3 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.866351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 939/1892] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:41.871990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:41.880104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 954/1893] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:41.893216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8875b-229e-4375-be2c-3ede2371981b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:41.900710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:41.901834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.902196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.902542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] PATH_INFO: `/v3/projects/3f8dec7c13b247af804ca26372f586b7/users/90a5ea5c374b41ebb620515e40d42288/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:41.927215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8dec7c13b247af804ca26372f586b7, user_id=90a5ea5c374b41ebb620515e40d42288, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:41.930734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:41.975456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 940/1894] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:41 2022] PUT /identity/v3/projects/3f8dec7c13b247af804ca26372f586b7/users/90a5ea5c374b41ebb620515e40d42288/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:41.983097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:41.983511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:41.984445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:42.055828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:42.058932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:42.236214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 955/1895] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:42.251530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:42.254925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:42.427523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3f596-aaa3-4c63-9044-ee0f41fa9e0a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:42.437468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:42.438598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:42.439333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:42.439841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:42.458480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:42.459866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7174185-d20e-469d-b32a-03123b49e1cf service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:42.483493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 941/1896] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:43.419390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:43.434925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de46656-1f8a-4215-a0bb-2cdca688ff74 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:43.441774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:43.442911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:43.443266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:43.449275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] PATH_INFO: `/v3/users/c8eaca3ab6a54fcb81b01cd7805d7b6d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:43.451973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8eaca3ab6a54fcb81b01cd7805d7b6d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:43.465778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:43.561883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8eaca3ab6a54fcb81b01cd7805d7b6d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:43.585925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8eaca3ab6a54fcb81b01cd7805d7b6d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:43.587386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8eaca3ab6a54fcb81b01cd7805d7b6d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:43.603838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8eaca3ab6a54fcb81b01cd7805d7b6d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:43.620706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f74f703a-b391-4531-97ca-0317ff6fe946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8eaca3ab6a54fcb81b01cd7805d7b6d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:43.630822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 956/1897] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:43 2022] DELETE /identity/v3/users/c8eaca3ab6a54fcb81b01cd7805d7b6d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:43.636840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:43.637407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:43.638152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:43.671164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:43.673876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:43.715711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19147d-3906-462b-a2a3-72ebe3ca965d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:43.716954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19147d-3906-462b-a2a3-72ebe3ca965d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:43.716954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19147d-3906-462b-a2a3-72ebe3ca965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:43.759342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-2f19147d-3906-462b-a2a3-72ebe3ca965d None None] MFA Rules not processed for user `a2f544b022f84fb291d0794dca05788d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:43.759342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2f19147d-3906-462b-a2a3-72ebe3ca965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:43.824974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 942/1898] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:43.856298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:43.858599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:43.965058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 957/1899] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:44.012544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee4b19-47c7-4a58-adee-189db96cc1c9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:44.019038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:44.019911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:44.020544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:44.020877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:44.036344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:44.039947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:44.058412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 943/1900] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:44.173987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:44.174497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:44.175161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:44.251362 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] MFA Rules not processed for user `90a5ea5c374b41ebb620515e40d42288`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:44.253264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:44.408303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 958/1901] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:44.410405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:44.413320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:44.492682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c96267-84a0-4eba-85de-c03391c31f90 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:44.514716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:44.524388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:44.524928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:44.525498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:44.526894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:44.539366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:44.634631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 944/1902] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:44 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:44.640470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:44.665270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16dfe2-8fb7-4854-a8d8-b30e67192ea2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:44.881575 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:44.882965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:44.883562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:44.884054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:44.891160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:44.904533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:44.928745 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:44.932272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:44.959396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 959/1903] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:44 2022] POST /identity/v3/users => generated 292 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:20:44.965798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:44.977755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14ce55-ae1a-4dcc-96fc-4c511a63f7f1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:44.988432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:44.989490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:44.989665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0265a-b4bd-4bb3-9ec0-4b781ff5c0c0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:44.989808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:44.990089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] PATH_INFO: `/v3/projects/8be82e1187864b8295dc32cee44fb730` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:44.993107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be82e1187864b8295dc32cee44fb730)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:44.995944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.007459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:45.008189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:45.008481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:45.008760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:45.009808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:45.012527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.038444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 960/1904] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:45.045325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:45.068454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4c159-d01f-4e6c-b132-f3c9af29a9f7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:45.125984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be82e1187864b8295dc32cee44fb730', 'request_id': 'req-53b64a65-428d-4d94-bb61-e218bfd21f92'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.147237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be82e1187864b8295dc32cee44fb730', 'request_id': 'req-53b64a65-428d-4d94-bb61-e218bfd21f92'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.169738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be82e1187864b8295dc32cee44fb730', 'request_id': 'req-53b64a65-428d-4d94-bb61-e218bfd21f92'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.199417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] The token cache is being invalidate because project 8be82e1187864b8295dc32cee44fb730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:45.199854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.201013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.206896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 945/1905] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:44 2022] DELETE /identity/v3/projects/8be82e1187864b8295dc32cee44fb730 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:45.211351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:45.213572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:45.255002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:45.259342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:45.261337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:45.262517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] PATH_INFO: `/v3/projects/8a9fe7258dfb4fd09c33291def43bb91/users/41823fa00f2c405fbb5d20751ce9d1c3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:45.295188 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9fe7258dfb4fd09c33291def43bb91, user_id=41823fa00f2c405fbb5d20751ce9d1c3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:45.303090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.338691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 961/1906] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:45 2022] PUT /identity/v3/projects/8a9fe7258dfb4fd09c33291def43bb91/users/41823fa00f2c405fbb5d20751ce9d1c3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:45.342032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:45.347022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:45.402266 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b64a65-428d-4d94-bb61-e218bfd21f92 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:45.559461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:45.561095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:45.561640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:45.562146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] PATH_INFO: `/v3/users/b6a29a81e8814365b9f57e7686a5edda` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:45.567679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a29a81e8814365b9f57e7686a5edda)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:45.571083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.636177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bd1be-d827-4661-a5cd-c6253141cd50 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:45.648934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:45.649691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:45.649691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:45.650806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:45.651643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:45.653464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.678830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a29a81e8814365b9f57e7686a5edda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.679697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a29a81e8814365b9f57e7686a5edda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.681141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 962/1907] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:45.689587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:45.693496 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:45.720539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a29a81e8814365b9f57e7686a5edda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.747529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a29a81e8814365b9f57e7686a5edda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.755800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a29a81e8814365b9f57e7686a5edda'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:45.759078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34079f76-7969-4702-9791-9b438753ce17 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:45.776971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:45.778567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:45.779128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:45.779614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] PATH_INFO: `/v3/projects/8a9fe7258dfb4fd09c33291def43bb91/users/41823fa00f2c405fbb5d20751ce9d1c3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:45.786540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9fe7258dfb4fd09c33291def43bb91, user_id=41823fa00f2c405fbb5d20751ce9d1c3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:45.792080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b6a390-6038-4c58-a130-85f52b0a6c85 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:45.797039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 946/1908] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:45 2022] DELETE /identity/v3/users/b6a29a81e8814365b9f57e7686a5edda => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:45.843293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 963/1909] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:45 2022] PUT /identity/v3/projects/8a9fe7258dfb4fd09c33291def43bb91/users/41823fa00f2c405fbb5d20751ce9d1c3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:46.927574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:46.930866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:47.140154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf29d9-47e5-4131-a49d-d8a2364b3f24 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:47.218632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:47.220838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.221470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.221845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] PATH_INFO: `/v3/projects/0ead8d66b97d4b68ac06cbab7787f134` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.223755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ead8d66b97d4b68ac06cbab7787f134)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:47.226135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:47.391009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ead8d66b97d4b68ac06cbab7787f134', 'request_id': 'req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:47.399612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ead8d66b97d4b68ac06cbab7787f134', 'request_id': 'req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:47.410057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ead8d66b97d4b68ac06cbab7787f134', 'request_id': 'req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:47.426621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] The token cache is being invalidate because project 0ead8d66b97d4b68ac06cbab7787f134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:47.426971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:47.428447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-46591b70-c9a2-49f1-9ba0-604f3ce1eebd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:47.436290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 947/1910] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:46 2022] DELETE /identity/v3/projects/0ead8d66b97d4b68ac06cbab7787f134 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:47.440383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.441004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.441219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.471000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:47.472448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:47.569446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 964/1911] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:47.580395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.580857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.581390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.618636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:47.619765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:47.637144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 948/1912] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:47.642807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:47.661987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f36344-53d7-44b0-9aed-c015956991b1 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:47.671105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:47.672639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.673982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.674709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.676513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:47.677385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:47.680699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:47.708128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 965/1913] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:47.713466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:47.730407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa4182-4b5f-4bc5-b7fe-10dc9b3c7863 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:47.742756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:47.744054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.744343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.744632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.749944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:47.752207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8099d-c645-47ba-934f-ecf79d3310de admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:47.828650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 949/1914] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:47 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:47.834076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:47.850711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044609-e3cf-4890-b5aa-55792bbf3ee1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:47.939294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.940158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.941579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:47.997246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:47.997775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:47.998477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:47.999151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.001550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.005523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.060787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 966/1915] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:47 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:48.062726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] MFA Rules not processed for user `41823fa00f2c405fbb5d20751ce9d1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:48.066207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.067655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:48.084522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b82c6-5f34-49a7-9e85-525dd3775a55 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:48.115192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:48.116722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.117462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.117970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.119498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.125221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.151697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 967/1916] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:48.160238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.198796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1325-1ed4-4e3b-80d8-5f2ae2adac85 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:48.221418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:48.222156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.222662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.223164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.224652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.233438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.308360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 950/1917] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:48.314749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.318181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 968/1918] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:48.319173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.321947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:48.330534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e237-9ea1-4f21-9ebd-59c0365b3ffa None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:48.337910 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:48.338921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.339209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.339487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] PATH_INFO: `/v3/projects/7380f91f30cf4862b70356e9767a52a5/users/14c37e0264a046f390a9e2e5f0fa15e6/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.367693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7380f91f30cf4862b70356e9767a52a5, user_id=14c37e0264a046f390a9e2e5f0fa15e6, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.373736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367c3fb-ceeb-47d7-82bf-90dca5a8696e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.427426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 951/1919] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:48 2022] PUT /identity/v3/projects/7380f91f30cf4862b70356e9767a52a5/users/14c37e0264a046f390a9e2e5f0fa15e6/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:48.438261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.438656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.442020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.477001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeaec01-0771-4730-a716-7799a6c11621 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:48.531799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] MFA Rules not processed for user `14c37e0264a046f390a9e2e5f0fa15e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:48.535778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:48.582183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:48.582849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.583129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.583403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.587926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:48.717772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.719274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.760846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 969/1920] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:48.768480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 952/1921] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:48.773773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.870680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19f09e-9dc5-460c-85be-5a7c8e514220 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:48.880430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:48.881613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:48.882089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:48.882520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:48.883389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:48.887073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:48.940943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 970/1922] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:48 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:48.942764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:48.980327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4057bd7-15c7-4b71-b844-714b09a6e796 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:49.153142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:49.155656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.156237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.156705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.160454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:49.164437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:49.217192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 953/1923] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:48 2022] POST /identity/v3/users => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:49.224661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:49.244972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f79ac-7d21-4c99-9688-5dd10112e31e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:49.256339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:49.258028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.258651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.259441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.261004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:49.265253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:49.293701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 971/1924] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:49.298959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:49.323443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d38140-7b5e-4d69-af74-0ffc269c75c4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:49.334121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:49.336134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.336990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.337748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] PATH_INFO: `/v3/projects/7efea6390874412c920885efb66a4e8e/users/53926c7361f442419081d85f80ee7cee/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.395288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efea6390874412c920885efb66a4e8e, user_id=53926c7361f442419081d85f80ee7cee, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:49.410365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:49.468808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 954/1925] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:49 2022] PUT /identity/v3/projects/7efea6390874412c920885efb66a4e8e/users/53926c7361f442419081d85f80ee7cee/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:49.476137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:49.499035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f55fb5-a7d1-4bfe-8b76-20d1c93c2bad admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:49.650128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:49.651353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.651631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.651905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.652674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:49.654596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e608d5f-7743-4b06-aabf-e157eeec3079 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:49.667068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 972/1926] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:49.671820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:49.691838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3babd0d-68b6-4a32-9fba-1c65dd42ec47 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:49.699499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:49.701645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.703271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.703600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] PATH_INFO: `/v3/projects/7efea6390874412c920885efb66a4e8e/users/53926c7361f442419081d85f80ee7cee/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.707727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efea6390874412c920885efb66a4e8e, user_id=53926c7361f442419081d85f80ee7cee, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:49.713866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:49.737024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 955/1927] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:49 2022] PUT /identity/v3/projects/7efea6390874412c920885efb66a4e8e/users/53926c7361f442419081d85f80ee7cee/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:49.747047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:49.747672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:49.748355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:49.794125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] MFA Rules not processed for user `53926c7361f442419081d85f80ee7cee`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:49.796650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:49.952040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 973/1928] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:49.967479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:49.970893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:50.187506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd0aa4-b47b-47c5-b874-6d24c90f7a3f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:50.201085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:50.201766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:50.202045 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:50.202318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:50.229774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:50.231313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:50.266301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 956/1929] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:50.399973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:50.427724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170d1cc-6cb3-4a21-b979-e3d23605c38f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:50.436564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:50.437773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:50.438305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:50.438843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:50.542445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:50.546576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:50.567646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 974/1930] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:20:50.727088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:50.745652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ab30d-7657-4ad4-8a67-2196b0c7c9f0 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:50.751017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:50.752125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:50.752571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:50.753056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:50.906662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:50.908855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983231d-9448-4cff-81ac-0f9a836d3619 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:50.926797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 957/1931] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:51.315436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:51.593017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa98669-84ea-4815-b19e-ee343be09a58 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:51.609230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:51.611889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:51.612736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:51.615161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] PATH_INFO: `/v3/users/14c37e0264a046f390a9e2e5f0fa15e6` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:51.618655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c37e0264a046f390a9e2e5f0fa15e6)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:51.625792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:51.750703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c37e0264a046f390a9e2e5f0fa15e6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:51.810449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c37e0264a046f390a9e2e5f0fa15e6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:51.811622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c37e0264a046f390a9e2e5f0fa15e6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:51.830361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c37e0264a046f390a9e2e5f0fa15e6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:51.847149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c37e0264a046f390a9e2e5f0fa15e6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:51.857574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 975/1932] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:51 2022] DELETE /identity/v3/users/14c37e0264a046f390a9e2e5f0fa15e6 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:51.864007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:51.864580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:51.865579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:51.910506 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:51.912177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:52.106670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 958/1933] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:52.132444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:52.136125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:52.288605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcd9f0-e8e4-4567-a8e8-874a43aa11b8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:52.305751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:52.307148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:52.307723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:52.308336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:52.333727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:52.337153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:52.383200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 976/1934] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:53.483162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:53.485676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:53.519937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd4245-88ba-4ab4-b273-ac71f18141c9 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:53.549617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:53.553461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:53.553738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:53.554027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] PATH_INFO: `/v3/projects/7380f91f30cf4862b70356e9767a52a5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:53.562652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7380f91f30cf4862b70356e9767a52a5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:53.572357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:53.669936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7380f91f30cf4862b70356e9767a52a5', 'request_id': 'req-192778b4-01a1-4fff-bb65-92188203dfcd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:53.691347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7380f91f30cf4862b70356e9767a52a5', 'request_id': 'req-192778b4-01a1-4fff-bb65-92188203dfcd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:53.711133 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7380f91f30cf4862b70356e9767a52a5', 'request_id': 'req-192778b4-01a1-4fff-bb65-92188203dfcd'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:53.765663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] The token cache is being invalidate because project 7380f91f30cf4862b70356e9767a52a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:53.766551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:53.768339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:53.775473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 959/1935] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:53 2022] DELETE /identity/v3/projects/7380f91f30cf4862b70356e9767a52a5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:53.779714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:53.802806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122ab0-a753-4a8f-87c6-23c49bb7dcd9 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:53.923995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:53.941351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:53.941752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:53.942011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] PATH_INFO: `/v3/users/53926c7361f442419081d85f80ee7cee` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:53.944791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53926c7361f442419081d85f80ee7cee)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:53.949339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:54.053803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53926c7361f442419081d85f80ee7cee'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.077142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53926c7361f442419081d85f80ee7cee'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.079153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53926c7361f442419081d85f80ee7cee'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.098513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53926c7361f442419081d85f80ee7cee'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.122332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-cc4f56e9-0581-4d96-a6f2-922ad53c6c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53926c7361f442419081d85f80ee7cee'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.148550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 977/1936] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:53 2022] DELETE /identity/v3/users/53926c7361f442419081d85f80ee7cee => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:54.698960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:54.702267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:54.748659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192778b4-01a1-4fff-bb65-92188203dfcd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:54.863636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:54.864543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:54.865030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:54.865247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] PATH_INFO: `/v3/projects/7efea6390874412c920885efb66a4e8e` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:54.867065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efea6390874412c920885efb66a4e8e)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:54.869181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:54.943556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efea6390874412c920885efb66a4e8e', 'request_id': 'req-06512beb-54b3-4840-9baa-3019809f8262'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.951008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efea6390874412c920885efb66a4e8e', 'request_id': 'req-06512beb-54b3-4840-9baa-3019809f8262'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.965526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efea6390874412c920885efb66a4e8e', 'request_id': 'req-06512beb-54b3-4840-9baa-3019809f8262'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.986106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] The token cache is being invalidate because project 7efea6390874412c920885efb66a4e8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:20:54.987517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.988520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-06512beb-54b3-4840-9baa-3019809f8262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:20:54.992411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 960/1937] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:20:54 2022] DELETE /identity/v3/projects/7efea6390874412c920885efb66a4e8e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:55.000088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.000593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.001585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.025668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:55.026910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:55.160087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 978/1938] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:20:55.175789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.176244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.176534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.211795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:55.214471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:55.231972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 961/1939] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:55.236233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.253374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aea715-abd0-460d-b837-42bc126a00e7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.258954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.259796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.260929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.260929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.261672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:20:55.262051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.263828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.281621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 979/1940] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:20:55.284290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.303071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5963ce8-090b-453c-a053-94150a412ae1 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.312748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.314190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.317183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.317183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.317183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.318022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.355410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 962/1941] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:20:55 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:55.361800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.382621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157370c-8449-4b99-8b5e-186c02255a54 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.502492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.504382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.504743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.505287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.506632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.520509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.565279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 980/1942] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:20:55 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:20:55.570849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.586565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354937-b149-4f8f-8f35-81f9bb9f613e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.594666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.596744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.597065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.597339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.598116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.599992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.615854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 963/1943] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:20:55.621855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.637360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f30be0-8028-4529-93ba-50345afaffd1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.659873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.667282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.667783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.668273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.669791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.673136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b278d6e7-e17e-4dee-ac1b-fda839766347 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.693587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 981/1944] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:20:55.700812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:55.737641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f169dc-bb77-490d-83e5-3beb0038ba49 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:55.748396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:55.750549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.751595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.752095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] PATH_INFO: `/v3/projects/e4f777797b974fe0a5312227bf9131d6/users/cfde254fd9204b03bc3881d4cd713daf/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.800489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f777797b974fe0a5312227bf9131d6, user_id=cfde254fd9204b03bc3881d4cd713daf, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:55.826411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:55.869460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 964/1945] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:20:55 2022] PUT /identity/v3/projects/e4f777797b974fe0a5312227bf9131d6/users/cfde254fd9204b03bc3881d4cd713daf/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:20:55.882025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:55.882830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:55.883480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:55.959102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] MFA Rules not processed for user `cfde254fd9204b03bc3881d4cd713daf`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:20:55.961260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:56.116831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 982/1946] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:20:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:20:56.133340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:56.137281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:20:56.304350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96697f5-8823-4bec-8f6a-f2a8b9246d6a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:20:56.312488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:20:56.314802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:20:56.314802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:20:56.314802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:20:56.326434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:20:56.328448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:20:56.341668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 965/1947] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:20:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:20:59.948249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:20:59.949875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:00.152603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584a2e1-fc92-4cb0-b8f1-8ddfbdc57b88 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:00.167064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:00.169621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:00.170568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:00.171355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] PATH_INFO: `/v3/users/2bc8a6f3334b4cb6bacb2757007578b1` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:00.175590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc8a6f3334b4cb6bacb2757007578b1)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:00.180611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:00.282899 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc8a6f3334b4cb6bacb2757007578b1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.306146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc8a6f3334b4cb6bacb2757007578b1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.307228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc8a6f3334b4cb6bacb2757007578b1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.319695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc8a6f3334b4cb6bacb2757007578b1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.335969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-abd9f38b-9b6c-4099-9b77-ca99bc618ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc8a6f3334b4cb6bacb2757007578b1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.349101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 983/1948] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:20:59 2022] DELETE /identity/v3/users/2bc8a6f3334b4cb6bacb2757007578b1 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:00.608672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:00.638603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb97176-9bde-487c-974d-0b22e34b661c service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:00.732869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:00.733787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:00.734066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:00.734363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] PATH_INFO: `/v3/projects/9ea72854422249cdb2433b90e5aa1252` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:00.736658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea72854422249cdb2433b90e5aa1252)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:00.738780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:00.790834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea72854422249cdb2433b90e5aa1252', 'request_id': 'req-6f40084d-f571-47eb-b295-b3a4b2398bbb'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.796568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea72854422249cdb2433b90e5aa1252', 'request_id': 'req-6f40084d-f571-47eb-b295-b3a4b2398bbb'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.805512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea72854422249cdb2433b90e5aa1252', 'request_id': 'req-6f40084d-f571-47eb-b295-b3a4b2398bbb'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.818389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] The token cache is being invalidate because project 9ea72854422249cdb2433b90e5aa1252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:00.818595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.819263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6f40084d-f571-47eb-b295-b3a4b2398bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:00.821134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 966/1949] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:00 2022] DELETE /identity/v3/projects/9ea72854422249cdb2433b90e5aa1252 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:00.832670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:00.833031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:00.833314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:00.852785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:00.854031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:00.919938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 984/1950] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:00.929435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:00.929724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:00.929977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:00.950986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:00.952457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:00.962415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 967/1951] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:00.967266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:00.978465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2d95c-57a1-4270-aeb3-9a995736bcea None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:00.983355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:00.984051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:00.984331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:00.984603 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:00.986221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:00.986593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:00.988248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.001831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 985/1952] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:01.008082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.018356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32445c-d301-40ce-833e-b0a6b84edaf0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.023622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.024563 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.024851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.025235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.026028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.027989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.075243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 968/1953] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:01 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:01.076919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.089211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4f18e-1aef-4c93-b025-14384be6d05b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.183244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.185738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.186653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.187428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.190591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.195776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.241567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 986/1954] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:01 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:01.246328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.259445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b2ee-d2bf-46a9-9fd4-da684bbe049b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.265277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.267826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.268318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.268860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.270273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.272465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.292158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 969/1955] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:01.293648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.306320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c2fdc-e901-431b-b5d5-023f1a610b41 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.311418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.312115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.312404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.312682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.314386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.316051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a96da-3fa9-4fc3-adf0-8eaace71e073 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.329762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 987/1956] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:01.336407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.354762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338504eb-2855-40a2-b66f-28f59f9778e3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.362851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.364507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.365071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.365592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] PATH_INFO: `/v3/projects/60a2cb34bfc74e9aa71c74b783aa5968/users/073ced14a6ff4ac2999c3e12938427f5/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.393231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a2cb34bfc74e9aa71c74b783aa5968, user_id=073ced14a6ff4ac2999c3e12938427f5, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.398710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.419582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 970/1957] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:01 2022] PUT /identity/v3/projects/60a2cb34bfc74e9aa71c74b783aa5968/users/073ced14a6ff4ac2999c3e12938427f5/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:01.431452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.431861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.432221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.484182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] MFA Rules not processed for user `073ced14a6ff4ac2999c3e12938427f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:01.486946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:01.595268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 988/1958] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:01.599896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.682008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902c8f3-ee49-4e16-83a7-f7852a9ccc96 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.686905 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.687583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.688460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.688980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.690040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.691975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.724714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 971/1959] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:01 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:21:01.729549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.742396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c20a56-eff4-4a87-9a99-1b9735e3dfec None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.809277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.810025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.810271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.810542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.811256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.813825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.843154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 989/1960] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:01 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:01.848147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.858659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c10d4-02e3-45f4-83ac-fee091c933f7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.864442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.865166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.865453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.865743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.866486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.868126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.881426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 972/1961] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:01.886140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.897636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ebff2-6354-49ff-aa2e-68e590c1084c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:01.904271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:01.905720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:01.906175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:01.907182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] PATH_INFO: `/v3/projects/9d49bdf48f93495a843525b0c09a476a/users/8c15e2ea55244004b2a49d4765d8b92e/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:01.934307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d49bdf48f93495a843525b0c09a476a, user_id=8c15e2ea55244004b2a49d4765d8b92e, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:01.938253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:01.957113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 990/1962] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:01 2022] PUT /identity/v3/projects/9d49bdf48f93495a843525b0c09a476a/users/8c15e2ea55244004b2a49d4765d8b92e/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:01.961862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:01.977205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b6da-18a8-4aa3-8861-2148b35cdebb admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:02.069644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:02.070634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:02.071088 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:02.071653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:02.072802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:02.075007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28c7da-2d5f-4e14-b529-6b89b93f7f22 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:02.094917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 973/1963] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:02.096517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:02.116481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5afce-7f0f-48a8-b5ee-2bda42086179 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:02.122592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:02.123798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:02.124078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:02.124356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] PATH_INFO: `/v3/projects/9d49bdf48f93495a843525b0c09a476a/users/8c15e2ea55244004b2a49d4765d8b92e/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:02.127494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d49bdf48f93495a843525b0c09a476a, user_id=8c15e2ea55244004b2a49d4765d8b92e, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:02.130338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:02.145843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 991/1964] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:02 2022] PUT /identity/v3/projects/9d49bdf48f93495a843525b0c09a476a/users/8c15e2ea55244004b2a49d4765d8b92e/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:02.156498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:02.157711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:02.157844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:02.190864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] MFA Rules not processed for user `8c15e2ea55244004b2a49d4765d8b92e`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:02.192342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:02.317316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 974/1965] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:21:02.351155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:02.353818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:02.460570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ba01c-e01c-4e7a-bf23-1b01965d1d6a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:02.465388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:02.466127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:02.466423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:02.466823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:02.481747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:02.483585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdd522-5bb7-48e8-810a-551e69e1839b service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:02.497397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 992/1966] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:03.181057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:03.294344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47eaf2-f5e8-4a21-a711-0a58fd87ebe4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:03.301719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:03.303085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:03.303583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:03.304073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] PATH_INFO: `/v3/users/073ced14a6ff4ac2999c3e12938427f5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:03.306022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073ced14a6ff4ac2999c3e12938427f5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:03.308733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:03.402067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073ced14a6ff4ac2999c3e12938427f5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:03.403107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073ced14a6ff4ac2999c3e12938427f5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:03.426412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073ced14a6ff4ac2999c3e12938427f5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:03.436266 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073ced14a6ff4ac2999c3e12938427f5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:03.437051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073ced14a6ff4ac2999c3e12938427f5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:03.451791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 975/1967] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:03 2022] DELETE /identity/v3/users/073ced14a6ff4ac2999c3e12938427f5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:03.457602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:03.458385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:03.458385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:03.479452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:03.481604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:03.561221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 993/1968] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:03.571353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:03.573068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:03.640728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e7602-4d06-42b5-a290-cf37501ccdc3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:03.645231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:03.645906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:03.646238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:03.646522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:03.658318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:03.660146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:03.673236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 976/1969] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:04.167567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:04.170555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:04.191344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e42cd-8f30-4912-924d-32d168e5a75e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:04.216304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:04.217228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:04.217696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:04.218202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] PATH_INFO: `/v3/projects/60a2cb34bfc74e9aa71c74b783aa5968` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:04.221682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a2cb34bfc74e9aa71c74b783aa5968)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:04.224540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:04.316812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a2cb34bfc74e9aa71c74b783aa5968', 'request_id': 'req-d9292cb7-7f66-4ecc-b981-3615d3689fc2'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.331193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a2cb34bfc74e9aa71c74b783aa5968', 'request_id': 'req-d9292cb7-7f66-4ecc-b981-3615d3689fc2'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.354191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a2cb34bfc74e9aa71c74b783aa5968', 'request_id': 'req-d9292cb7-7f66-4ecc-b981-3615d3689fc2'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.377237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] The token cache is being invalidate because project 60a2cb34bfc74e9aa71c74b783aa5968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:04.377825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.379656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.382497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 994/1970] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:04 2022] DELETE /identity/v3/projects/60a2cb34bfc74e9aa71c74b783aa5968 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:04.388577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:04.403726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25983534-2f00-45c4-a505-222515a46014 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:04.531355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:04.533852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:04.534347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:04.535054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] PATH_INFO: `/v3/users/8c15e2ea55244004b2a49d4765d8b92e` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:04.537252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c15e2ea55244004b2a49d4765d8b92e)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:04.539423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:04.613214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c15e2ea55244004b2a49d4765d8b92e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.614027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c15e2ea55244004b2a49d4765d8b92e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.631618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c15e2ea55244004b2a49d4765d8b92e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.642776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c15e2ea55244004b2a49d4765d8b92e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.643861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e832e9f3-5e73-4455-8c9a-628eac9c067b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c15e2ea55244004b2a49d4765d8b92e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:04.662009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 977/1971] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:04 2022] DELETE /identity/v3/users/8c15e2ea55244004b2a49d4765d8b92e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:05.053399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.055846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:05.076151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9292cb7-7f66-4ecc-b981-3615d3689fc2 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.165560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.166441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.166719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.166995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] PATH_INFO: `/v3/projects/9d49bdf48f93495a843525b0c09a476a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.168319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d49bdf48f93495a843525b0c09a476a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.170686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.228292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d49bdf48f93495a843525b0c09a476a', 'request_id': 'req-0f3983f6-2351-4e71-9a95-744f439e7986'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:05.235130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d49bdf48f93495a843525b0c09a476a', 'request_id': 'req-0f3983f6-2351-4e71-9a95-744f439e7986'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:05.244223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d49bdf48f93495a843525b0c09a476a', 'request_id': 'req-0f3983f6-2351-4e71-9a95-744f439e7986'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:05.260937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] The token cache is being invalidate because project 9d49bdf48f93495a843525b0c09a476a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:05.261238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:05.261921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f3983f6-2351-4e71-9a95-744f439e7986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:05.263505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 995/1972] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:05 2022] DELETE /identity/v3/projects/9d49bdf48f93495a843525b0c09a476a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:05.269538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.270084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.270596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.291699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:05.292942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:05.377253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 978/1973] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:05.386481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.386888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.387266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.410393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:05.411875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:05.423939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 996/1974] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:05.428302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.439566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e96861-7d5f-45eb-a58a-e641ecabedc7 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.448805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.449625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.449982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.450446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.451201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:05.451673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.453434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.469631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 979/1975] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:05.474374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.493141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a2ee5-f65e-49dd-a508-0ea9182cce12 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.500048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.501613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.501899 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.502179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.502898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.505594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.537516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 997/1976] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:05 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:05.542099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.567636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb01357-6ffa-47a0-be6a-10b9faed9822 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.664726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.665602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.666044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.666334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.667108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.670315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.696141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 980/1977] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:05 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:05.702125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.714115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26460ad5-ffaf-4f60-9dde-315fced1ba53 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.732186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.732863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.733194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.733443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.734162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.736336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.750116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 998/1978] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:05.757073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.771879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa47203-7ad8-4721-afc3-5e76c77b9f74 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.776864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.777580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.777863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.778158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.778920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.780552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b8ded-cbac-416b-9eeb-a7cf1f1d9fbe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.792825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 981/1979] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:05.798187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:05.808995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff9cdd-13f3-404f-ac9f-bca61b3d79e7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:05.814753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:05.815647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.816645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.816976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] PATH_INFO: `/v3/projects/301200b0b1ae41b293abc71472a63dc3/users/b8654eab60db492fa3c3fb820b63ebf1/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.834379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301200b0b1ae41b293abc71472a63dc3, user_id=b8654eab60db492fa3c3fb820b63ebf1, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:05.837387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:05.859014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 999/1980] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:05 2022] PUT /identity/v3/projects/301200b0b1ae41b293abc71472a63dc3/users/b8654eab60db492fa3c3fb820b63ebf1/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:05.882493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:05.883018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:05.883692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:05.928374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] MFA Rules not processed for user `b8654eab60db492fa3c3fb820b63ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:05.929965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:06.024066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 982/1981] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:06.028864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.133364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043029a-a842-4540-a7c9-e618c4be6b56 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.138317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.138990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.139270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.139543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.140265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.143040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.173589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1000/1982] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:06 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:06.178452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.191610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02aed-0a78-4bb7-a8b2-04d47aaa0314 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.260020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.260715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.261100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.261379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.262171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.264284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.293533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 983/1983] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:06 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:06.299235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.312245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406ae39-ff72-4217-8d62-0b306baf4511 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.319565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.320567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.321093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.321551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.322709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.325054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.344822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1001/1984] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:06.349363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.364382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b0ee8-b238-4d4a-9ee4-0bf3d3f0d11b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.373346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.374986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.375594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.377384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] PATH_INFO: `/v3/projects/5b1924427ade4da4b8845ff9b619143c/users/d70f5d7bdd82412687395815d6215144/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.398779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1924427ade4da4b8845ff9b619143c, user_id=d70f5d7bdd82412687395815d6215144, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.402014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.421255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 984/1985] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:06 2022] PUT /identity/v3/projects/5b1924427ade4da4b8845ff9b619143c/users/d70f5d7bdd82412687395815d6215144/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:06.426427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.437710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee60b9-5c9b-402f-9adc-38003fd71cb9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.536691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.537499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.537854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.538221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.539053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.540811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc881fc-788b-4412-83ea-7e681f705a0e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.551961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1002/1986] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:06.557202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.574433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b932640-c6fe-4631-8cd2-2d8d129a9398 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.583900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.585622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.586150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.586675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] PATH_INFO: `/v3/projects/5b1924427ade4da4b8845ff9b619143c/users/d70f5d7bdd82412687395815d6215144/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.590271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1924427ade4da4b8845ff9b619143c, user_id=d70f5d7bdd82412687395815d6215144, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.595445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.610017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 985/1987] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:06 2022] PUT /identity/v3/projects/5b1924427ade4da4b8845ff9b619143c/users/d70f5d7bdd82412687395815d6215144/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:06.629493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.630104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.630680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.675240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] MFA Rules not processed for user `d70f5d7bdd82412687395815d6215144`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:06.676511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:06.779953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1003/1988] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:06.792716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:06.794734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:06.891599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7400-2c41-4a6c-84f3-b64d99396991 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:06.899392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:06.900099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:06.900392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:06.900723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:06.912824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:06.914392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6208130-bced-438c-bf04-8c0bb35acd38 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:06.925825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 986/1989] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:07.007737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:07.107013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446125e-254a-45de-b050-2eb5d242f79a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:07.114046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:07.115065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:07.115370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:07.115696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] PATH_INFO: `/v3/users/b8654eab60db492fa3c3fb820b63ebf1` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:07.117226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8654eab60db492fa3c3fb820b63ebf1)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:07.119208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:07.184500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8654eab60db492fa3c3fb820b63ebf1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:07.199099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8654eab60db492fa3c3fb820b63ebf1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:07.199886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8654eab60db492fa3c3fb820b63ebf1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:07.209516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8654eab60db492fa3c3fb820b63ebf1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:07.220971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8654eab60db492fa3c3fb820b63ebf1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:07.233159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1004/1990] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:07 2022] DELETE /identity/v3/users/b8654eab60db492fa3c3fb820b63ebf1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:07.238797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:07.239393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:07.239984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:07.268955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:07.270248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:07.370642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 987/1991] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:21:07.381921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:07.384613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:07.482203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ab396-065e-45db-8037-ae8a9ed3be92 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:07.486920 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:07.487592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:07.487872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:07.488142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:07.501205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:07.502799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:07.514231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1005/1992] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:21:07.957718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:07.960019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:07.976225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c18908-831b-45c6-a5a8-63533747b9c4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:07.982376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:07.983360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:07.983819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:07.984287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] PATH_INFO: `/v3/projects/301200b0b1ae41b293abc71472a63dc3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:07.986896 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301200b0b1ae41b293abc71472a63dc3)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:07.989226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:08.043102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301200b0b1ae41b293abc71472a63dc3', 'request_id': 'req-b4d76255-39e7-4298-b6e3-c1c80c8aa020'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.050157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301200b0b1ae41b293abc71472a63dc3', 'request_id': 'req-b4d76255-39e7-4298-b6e3-c1c80c8aa020'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.058966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301200b0b1ae41b293abc71472a63dc3', 'request_id': 'req-b4d76255-39e7-4298-b6e3-c1c80c8aa020'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.072698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] The token cache is being invalidate because project 301200b0b1ae41b293abc71472a63dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:08.073018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.073703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.075281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 988/1993] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:07 2022] DELETE /identity/v3/projects/301200b0b1ae41b293abc71472a63dc3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:08.080077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:08.090000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce78729-5f78-43e0-841f-bcc9aec62924 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:08.175513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:08.176311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:08.176592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:08.176866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] PATH_INFO: `/v3/users/d70f5d7bdd82412687395815d6215144` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:08.178171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70f5d7bdd82412687395815d6215144)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:08.180129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:08.238850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70f5d7bdd82412687395815d6215144'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.253636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70f5d7bdd82412687395815d6215144'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.254585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70f5d7bdd82412687395815d6215144'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.263167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70f5d7bdd82412687395815d6215144'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.272309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-39514ce0-8c48-409e-b312-ccef46d1a9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70f5d7bdd82412687395815d6215144'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.279437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1006/1994] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:08 2022] DELETE /identity/v3/users/d70f5d7bdd82412687395815d6215144 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:08.581059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:08.583229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:08.597749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76255-39e7-4298-b6e3-c1c80c8aa020 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:08.697919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:08.698895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:08.699200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:08.699695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] PATH_INFO: `/v3/projects/5b1924427ade4da4b8845ff9b619143c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:08.701130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1924427ade4da4b8845ff9b619143c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:08.703957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:08.757995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1924427ade4da4b8845ff9b619143c', 'request_id': 'req-996cdb6c-4a84-498a-a79e-1c78319b0875'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.764505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1924427ade4da4b8845ff9b619143c', 'request_id': 'req-996cdb6c-4a84-498a-a79e-1c78319b0875'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.774875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1924427ade4da4b8845ff9b619143c', 'request_id': 'req-996cdb6c-4a84-498a-a79e-1c78319b0875'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.787984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] The token cache is being invalidate because project 5b1924427ade4da4b8845ff9b619143c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:08.788282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.789135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-996cdb6c-4a84-498a-a79e-1c78319b0875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:08.790829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 989/1995] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:08 2022] DELETE /identity/v3/projects/5b1924427ade4da4b8845ff9b619143c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:08.796069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:08.796356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:08.796635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:08.816606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:08.817880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:08.889401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1007/1996] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:08.898826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:08.899245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:08.899676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:08.921890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:08.923665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:08.935495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 990/1997] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:08.940626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:08.954315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a578e7-d4b8-4398-8c7a-40005d53fe3c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:08.957763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:08.958559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:08.958876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:08.959156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:08.959968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:08.960310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:08.962187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:08.978731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1008/1998] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:08.983267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:08.995341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754dae0-a611-403e-9012-0f415fb91779 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.004028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.004801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.005198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.005616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.006420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.008840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.041754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 991/1999] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:09.042952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:09.054206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420be1e5-4ee5-4d63-8572-55f02cdf5e69 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.117396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.118092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.118420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.118704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.119505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.121572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.145942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1009/2000] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:09 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:21:09.150573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:09.163530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67fb93-dba2-4a90-bb3b-52ed52d5d1aa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.168618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.169353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.169637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.169919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.170677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.173276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.184649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 992/2001] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:09.190714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:09.201206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4a34a-5deb-4945-af6e-f34eacf386a8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.207073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.207670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.207961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.208222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.209019 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.210667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84392184-36e6-4a07-ad03-72a712a07fe2 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.222927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1010/2002] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:09.228505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:09.239714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09774e58-24f9-469c-bc51-b38c9c4dea3e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.244629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.245566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.245852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.246129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] PATH_INFO: `/v3/projects/afb332251e094a6293c74e01a54efa03/users/1b358eb145df46dbb03c5249349afc1f/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.263165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb332251e094a6293c74e01a54efa03, user_id=1b358eb145df46dbb03c5249349afc1f, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.266640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.281003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 993/2003] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:09 2022] PUT /identity/v3/projects/afb332251e094a6293c74e01a54efa03/users/1b358eb145df46dbb03c5249349afc1f/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:09.297239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60bb6-97b9-42b3-98d1-16e14e3edab1 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.297778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60bb6-97b9-42b3-98d1-16e14e3edab1 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.298207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d60bb6-97b9-42b3-98d1-16e14e3edab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.327754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-81d60bb6-97b9-42b3-98d1-16e14e3edab1 None None] MFA Rules not processed for user `1b358eb145df46dbb03c5249349afc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:09.329676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-81d60bb6-97b9-42b3-98d1-16e14e3edab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:09.399020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1011/2004] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:09.409609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:09.411340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:09.474336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4a889-6f4d-4830-9f06-8658a4bdb8a4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:09.478288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:09.478975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:09.479265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:09.479627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:09.489293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:09.490863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:09.503743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 994/2005] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:14.092688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:14.093184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:14.093326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:14.119887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] MFA Rules not processed for user `a2f544b022f84fb291d0794dca05788d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:14.120943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:14.194042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1012/2006] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:14.298916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:14.302719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:14.407854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c00a-3dcd-4937-899c-b6a7cd09ec0a service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:14.413913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:14.414818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:14.415103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:14.415377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] PATH_INFO: `/v3/users/90a5ea5c374b41ebb620515e40d42288` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:14.416710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a5ea5c374b41ebb620515e40d42288)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:14.418705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:14.481233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a5ea5c374b41ebb620515e40d42288'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:14.481924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a5ea5c374b41ebb620515e40d42288'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:14.499271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a5ea5c374b41ebb620515e40d42288'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:14.507932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a5ea5c374b41ebb620515e40d42288'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:14.508676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a5ea5c374b41ebb620515e40d42288'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:14.531631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 995/2007] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:14 2022] DELETE /identity/v3/users/90a5ea5c374b41ebb620515e40d42288 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:14.938159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:14.980056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a0f93-f8c4-4b31-bd9d-fe2194113cef None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:15.099048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:15.102332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:15.103024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:15.103746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] PATH_INFO: `/v3/projects/3f8dec7c13b247af804ca26372f586b7` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:15.106234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8dec7c13b247af804ca26372f586b7)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:15.110449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:15.192600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8dec7c13b247af804ca26372f586b7', 'request_id': 'req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.199631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8dec7c13b247af804ca26372f586b7', 'request_id': 'req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.212734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8dec7c13b247af804ca26372f586b7', 'request_id': 'req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.226071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] The token cache is being invalidate because project 3f8dec7c13b247af804ca26372f586b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:15.226279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.226977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.228838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1013/2008] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:14 2022] DELETE /identity/v3/projects/3f8dec7c13b247af804ca26372f586b7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:15.234825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:15.236935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:15.253281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05da28-02e1-446b-971c-34358d5933b1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:15.326732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:15.327794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:15.328857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:15.329789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] PATH_INFO: `/v3/users/41823fa00f2c405fbb5d20751ce9d1c3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:15.331078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=41823fa00f2c405fbb5d20751ce9d1c3)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:15.333135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:15.398639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41823fa00f2c405fbb5d20751ce9d1c3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.399333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41823fa00f2c405fbb5d20751ce9d1c3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.419493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41823fa00f2c405fbb5d20751ce9d1c3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.428802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41823fa00f2c405fbb5d20751ce9d1c3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.429902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-526b2c17-3937-42f7-9d00-013e883920bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41823fa00f2c405fbb5d20751ce9d1c3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.449677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 996/2009] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:15 2022] DELETE /identity/v3/users/41823fa00f2c405fbb5d20751ce9d1c3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:15.674770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:15.676693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:15.699041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307ab-80ce-4a8b-9c6a-38f09ec129c9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:15.785477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:15.786551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:15.786846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:15.787227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] PATH_INFO: `/v3/projects/8a9fe7258dfb4fd09c33291def43bb91` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:15.788672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9fe7258dfb4fd09c33291def43bb91)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:15.791493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:15.846521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9fe7258dfb4fd09c33291def43bb91', 'request_id': 'req-52b9be41-60bc-4ac9-8e3c-dd91586da02b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.852260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9fe7258dfb4fd09c33291def43bb91', 'request_id': 'req-52b9be41-60bc-4ac9-8e3c-dd91586da02b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.861132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9fe7258dfb4fd09c33291def43bb91', 'request_id': 'req-52b9be41-60bc-4ac9-8e3c-dd91586da02b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.873217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] The token cache is being invalidate because project 8a9fe7258dfb4fd09c33291def43bb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:15.873507 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.874168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-52b9be41-60bc-4ac9-8e3c-dd91586da02b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:15.877190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1014/2010] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:15 2022] DELETE /identity/v3/projects/8a9fe7258dfb4fd09c33291def43bb91 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:15.882355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:15.882697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:15.883017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:15.903615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:15.904839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:15.970909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 997/2011] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:15.979787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:15.980177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:15.980506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.002903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:16.004162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:16.012833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1015/2012] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:16.018691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.028769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17569d1c-245b-4dc9-bca6-6a17cfee8137 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.035080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.035765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.036047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.036326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.037123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:16.037435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.039098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.053118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 998/2013] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:16.057751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.069101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23950e-dc8a-442e-ba8a-7dbb21566730 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.074686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.075751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.076220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.076685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.078805 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.081671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.116396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1016/2014] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:16 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:16.118075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.129801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024cc1b-846b-42b6-bccf-e7a0919294ef admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.221443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.223347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.223347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.223907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.225970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.230988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.275343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 999/2015] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:16 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:21:16.282155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.305328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cbd81-0814-434f-9f0b-259c837ddb3d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.313964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.315278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.316068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.316828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.318469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.320610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.339965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1017/2016] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:16.345431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.363829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8331365-eb73-4437-b1e2-81997974f7e5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.372015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.373403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.373903 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.374389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.376706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.379867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7912e-6da5-4a45-be32-ae50c3c90a78 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.399605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1000/2017] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:16.404041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.416185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b74d7-035c-4fa9-b916-0bc34ebac244 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.421283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.422756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.423033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.423442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] PATH_INFO: `/v3/projects/d062ec29addb4b1d816e7123b47378d4/users/97bc21e59cfe4b2bb7225cbd4ac878d1/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.439801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d062ec29addb4b1d816e7123b47378d4, user_id=97bc21e59cfe4b2bb7225cbd4ac878d1, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.442547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.456954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1018/2018] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:16 2022] PUT /identity/v3/projects/d062ec29addb4b1d816e7123b47378d4/users/97bc21e59cfe4b2bb7225cbd4ac878d1/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:16.468951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.469268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.469546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.501269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] MFA Rules not processed for user `97bc21e59cfe4b2bb7225cbd4ac878d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:16.502488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:16.578827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1001/2019] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:16.583586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.654982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdada8c-1329-448c-96ea-59e83cdd1640 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.660989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.661757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.662056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.662448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.663077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.665144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.704149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1019/2020] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:16 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:16.710509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.731182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b94896-59db-4df4-88cb-a5d00afc46dd None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.821618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.822047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.822520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.822945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.824030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.826633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.850746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1002/2021] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:16 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:16.855700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.869908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f59bc0-86cf-41f1-b8fa-afe2f0288ad6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.877611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.878470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.878936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.879380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.880284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.882240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.895546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1020/2022] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:16.900866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.917113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d51-59c9-4c83-a23d-f3a7af20a018 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.925251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.926409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.926902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.927384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.928805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.931881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1a1fd-645b-4f3f-b240-f197d1f47473 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:16.947495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1003/2023] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:16.954263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:16.970411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1eb0-cad3-46d4-a1a6-4f8318fad1ec admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:16.975629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:16.976534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:16.976815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:16.977132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] PATH_INFO: `/v3/projects/dd950f7dd98c4e41ba8d4a4dcd16d38e/users/1f30d27f0a7d4b57bb3a1a3106ab9b34/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:16.994238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd950f7dd98c4e41ba8d4a4dcd16d38e, user_id=1f30d27f0a7d4b57bb3a1a3106ab9b34, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:16.996974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.013303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1021/2024] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:16 2022] PUT /identity/v3/projects/dd950f7dd98c4e41ba8d4a4dcd16d38e/users/1f30d27f0a7d4b57bb3a1a3106ab9b34/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:17.025657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.026102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.026525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.057982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] MFA Rules not processed for user `1f30d27f0a7d4b57bb3a1a3106ab9b34`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:17.059197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:17.132559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1004/2025] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:17.137177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.208314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb822-48a5-4b7d-8dc1-8503c05a7824 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.213030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.213687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.213963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.214235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.214973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.216933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.243632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1022/2026] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:17 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:17.248031 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.261838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295ddb7-f0a3-45ed-a406-d0e2abfcc668 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.322571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.323256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.323543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.323823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.324546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.326537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.350447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1005/2027] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:17 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:17.356867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.379618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a52a8-cdc4-4226-a2b9-2001ec2ef7b9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.388801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.390297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.391778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.392249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.393549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.405142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.425328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1023/2028] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:17.426843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.441796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0ca6d-399d-420b-bd3b-03b84b5e928a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.447497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.448636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.449365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.450066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] PATH_INFO: `/v3/projects/f5e97b6e715341c787ccf312507059b2/users/e10bedd5d26a4d3cadcd1f5c08358180/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.475222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e97b6e715341c787ccf312507059b2, user_id=e10bedd5d26a4d3cadcd1f5c08358180, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.479304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.495744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1006/2029] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:17 2022] PUT /identity/v3/projects/f5e97b6e715341c787ccf312507059b2/users/e10bedd5d26a4d3cadcd1f5c08358180/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:17.500276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.511010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb9ad1-2daf-4dc3-ba2f-1f193892faae admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.576202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.577079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.577365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.577643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.579249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.580875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8390c-9850-45e5-8062-e2bf60c53226 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.592959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1024/2030] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:17.602008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.612521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bf8b-4b46-458b-8b56-9c7c20f334a4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.617564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.618484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.618774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.619057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] PATH_INFO: `/v3/projects/f5e97b6e715341c787ccf312507059b2/users/e10bedd5d26a4d3cadcd1f5c08358180/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.621181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e97b6e715341c787ccf312507059b2, user_id=e10bedd5d26a4d3cadcd1f5c08358180, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.624404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.636649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1007/2031] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:17 2022] PUT /identity/v3/projects/f5e97b6e715341c787ccf312507059b2/users/e10bedd5d26a4d3cadcd1f5c08358180/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:17.647667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.647956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.648237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.675898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] MFA Rules not processed for user `e10bedd5d26a4d3cadcd1f5c08358180`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:17.677162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:17.746537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1025/2032] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:17.758383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:17.760370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:17.819764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc33131-3f51-432b-b94f-59d115b04d95 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:17.823658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:17.824316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:17.824584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:17.824842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:17.881253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:17.882691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:17.893047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1008/2033] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:21.810844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:21.824992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b5253-9d8e-4f42-bba9-e4728f76b176 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:21.830820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:21.832113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:21.832582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:21.833120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:21.914160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:21.916939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:21.934704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1026/2034] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:22.729068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:22.743500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a971e-a0e0-489d-abed-1ee17b5d9730 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:22.750305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:22.751348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:22.751888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:22.752329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:22.763685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:22.766193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ce744-86d0-4037-8cc6-c30bb1eef888 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:22.779178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1009/2035] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:22.887134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:22.889833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:22.978216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1210a5-a3ff-4068-aee4-6fd562a4110e service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:22.983026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:22.983904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:22.984224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:22.984583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] PATH_INFO: `/v3/users/1b358eb145df46dbb03c5249349afc1f` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:22.985939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b358eb145df46dbb03c5249349afc1f)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:22.988040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:23.054363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b358eb145df46dbb03c5249349afc1f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.071136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b358eb145df46dbb03c5249349afc1f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.071994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b358eb145df46dbb03c5249349afc1f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.080454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b358eb145df46dbb03c5249349afc1f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.089597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b358eb145df46dbb03c5249349afc1f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.098905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1027/2036] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:22 2022] DELETE /identity/v3/users/1b358eb145df46dbb03c5249349afc1f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:23.104161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597ab7-307e-469a-9371-28aea195084a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:23.104445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597ab7-307e-469a-9371-28aea195084a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:23.105607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597ab7-307e-469a-9371-28aea195084a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:23.130676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0c597ab7-307e-469a-9371-28aea195084a None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:23.132010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0c597ab7-307e-469a-9371-28aea195084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:23.203604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1010/2037] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:23.214179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:23.216133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:23.280942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1080c-bd77-4d8d-9616-9870104ff150 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:23.284867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:23.285693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:23.286037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:23.286142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:23.297092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:23.299635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a757f-8756-4799-9059-f51f05b0fb2d service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:23.310678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1028/2038] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:23.689121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597ab7-307e-469a-9371-28aea195084a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:23.691306 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0c597ab7-307e-469a-9371-28aea195084a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:23.713582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597ab7-307e-469a-9371-28aea195084a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:23.724578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:23.725861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:23.726260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:23.726583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] PATH_INFO: `/v3/projects/afb332251e094a6293c74e01a54efa03` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:23.728601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb332251e094a6293c74e01a54efa03)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:23.731349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:23.788383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb332251e094a6293c74e01a54efa03', 'request_id': 'req-d29f26db-30af-41bb-892c-ae53fcac91b7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.796132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb332251e094a6293c74e01a54efa03', 'request_id': 'req-d29f26db-30af-41bb-892c-ae53fcac91b7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.805960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb332251e094a6293c74e01a54efa03', 'request_id': 'req-d29f26db-30af-41bb-892c-ae53fcac91b7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.819305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] The token cache is being invalidate because project afb332251e094a6293c74e01a54efa03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:23.819601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.822678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-d29f26db-30af-41bb-892c-ae53fcac91b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:23.824655 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1011/2039] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:23 2022] DELETE /identity/v3/projects/afb332251e094a6293c74e01a54efa03 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:23.832250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:23.832514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:23.832769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:23.855565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:23.857938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:23.944612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1029/2040] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:23.955468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:23.955845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:23.956022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:23.977691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:23.979235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:23.994050 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1012/2041] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:23.994780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.006029 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090a4e4-4a5c-4bec-8a18-80895ae98c62 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.014895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.016430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.016822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.017286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.018442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:24.018886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.021003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.038063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1030/2042] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:24.042675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.053395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29fb7-889f-4d42-80f0-17fb6e3facd8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.058899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.059670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.060043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.060416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.061495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.065275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.110630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1013/2043] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:24 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:24.116409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.129611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d0cd1-05aa-452a-ae07-8c9bd176c795 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.193871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.194555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.194860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.195144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.195868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.197954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.221651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1031/2044] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:24 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:24.226374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.238001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2292-87cc-42d9-b014-27803f053dd6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.243933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.244843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.245130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.245440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.246333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.248275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.261458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1014/2045] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:21:24.266344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.277947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ada4c-03e5-47f3-8a32-3518bad18d57 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.283600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.284280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.284701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.285015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.285779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.287456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bec095-0503-4e33-afab-e2e5522c93f1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.298814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1032/2046] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:24.303326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.315200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce24d3-8d6a-42e0-bc57-e35a57baf352 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.320300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.321263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.321553 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.321831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] PATH_INFO: `/v3/projects/6e4a235605e74719ab6090eea7a10458/users/c5f5f6823db646efa99c39447c740687/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.340871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4a235605e74719ab6090eea7a10458, user_id=c5f5f6823db646efa99c39447c740687, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.344349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.359864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1015/2047] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:24 2022] PUT /identity/v3/projects/6e4a235605e74719ab6090eea7a10458/users/c5f5f6823db646efa99c39447c740687/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:24.371053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.371342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.371632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.401207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] MFA Rules not processed for user `c5f5f6823db646efa99c39447c740687`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:24.402433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:24.476000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1033/2048] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:24.487436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:24.489504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:24.550803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcd7ee-f2da-428d-a413-025127da62a6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:24.554613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:24.555280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:24.555565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:24.555838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:24.565373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:24.566785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf83061-199c-459b-8620-c94261451dc1 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:24.576485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1016/2049] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:52.731323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:52.734256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:52.838528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c960c52-b33c-4b9b-b93f-7e4b76216461 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:52.845087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:52.846025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:52.846560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:52.846886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] PATH_INFO: `/v3/users/97bc21e59cfe4b2bb7225cbd4ac878d1` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:52.848310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97bc21e59cfe4b2bb7225cbd4ac878d1)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:52.850675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:52.902688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97bc21e59cfe4b2bb7225cbd4ac878d1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:52.917054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97bc21e59cfe4b2bb7225cbd4ac878d1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:52.917938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97bc21e59cfe4b2bb7225cbd4ac878d1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:52.929280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97bc21e59cfe4b2bb7225cbd4ac878d1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:52.938850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97bc21e59cfe4b2bb7225cbd4ac878d1'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:52.951085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1034/2050] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:52 2022] DELETE /identity/v3/users/97bc21e59cfe4b2bb7225cbd4ac878d1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:52.957447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:52.958576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:52.959408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:52.990004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:52.992002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:53.075293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1017/2051] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:21:53.087645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:53.090091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:53.179018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f38f45-4af0-4b9f-98a8-257817560029 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:53.183555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:53.184269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:53.184555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:53.184998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:53.195988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:53.197501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:53.211656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1035/2052] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:53.565055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:53.566683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:53.580030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015b43e-693e-4e9d-b6bb-35c6192e9888 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:53.584951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:53.585851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:53.586137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:53.586417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] PATH_INFO: `/v3/projects/d062ec29addb4b1d816e7123b47378d4` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:53.587866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d062ec29addb4b1d816e7123b47378d4)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:53.590344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:53.674135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd062ec29addb4b1d816e7123b47378d4', 'request_id': 'req-8f941e14-6cfe-4222-bc3e-b3beecedfd45'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.691681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd062ec29addb4b1d816e7123b47378d4', 'request_id': 'req-8f941e14-6cfe-4222-bc3e-b3beecedfd45'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.700413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd062ec29addb4b1d816e7123b47378d4', 'request_id': 'req-8f941e14-6cfe-4222-bc3e-b3beecedfd45'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.726709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] The token cache is being invalidate because project d062ec29addb4b1d816e7123b47378d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:53.727398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.728731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.730714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1018/2053] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:53 2022] DELETE /identity/v3/projects/d062ec29addb4b1d816e7123b47378d4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:53.736875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:53.748466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e18458-bed0-44bb-8e13-0e5b4e0340e5 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:53.813868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:53.814761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:53.815043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:53.815394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] PATH_INFO: `/v3/users/1f30d27f0a7d4b57bb3a1a3106ab9b34` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:53.816630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f30d27f0a7d4b57bb3a1a3106ab9b34)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:53.818693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:53.881354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f30d27f0a7d4b57bb3a1a3106ab9b34'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.902776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f30d27f0a7d4b57bb3a1a3106ab9b34'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.903958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f30d27f0a7d4b57bb3a1a3106ab9b34'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.917912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f30d27f0a7d4b57bb3a1a3106ab9b34'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.929652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f30d27f0a7d4b57bb3a1a3106ab9b34'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:53.936697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1036/2054] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:53 2022] DELETE /identity/v3/users/1f30d27f0a7d4b57bb3a1a3106ab9b34 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:54.259213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:54.262075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:54.281461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941e14-6cfe-4222-bc3e-b3beecedfd45 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:54.349827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:54.350698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:54.350983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:54.351287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] PATH_INFO: `/v3/projects/dd950f7dd98c4e41ba8d4a4dcd16d38e` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:54.352651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd950f7dd98c4e41ba8d4a4dcd16d38e)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:54.354654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:54.407631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd950f7dd98c4e41ba8d4a4dcd16d38e', 'request_id': 'req-622c75cf-e52f-492c-9a37-fb47e77ba2a5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.414926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd950f7dd98c4e41ba8d4a4dcd16d38e', 'request_id': 'req-622c75cf-e52f-492c-9a37-fb47e77ba2a5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.426937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd950f7dd98c4e41ba8d4a4dcd16d38e', 'request_id': 'req-622c75cf-e52f-492c-9a37-fb47e77ba2a5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.444775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] The token cache is being invalidate because project dd950f7dd98c4e41ba8d4a4dcd16d38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:54.445087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.445854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.447598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1019/2055] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:54 2022] DELETE /identity/v3/projects/dd950f7dd98c4e41ba8d4a4dcd16d38e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:54.454003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:54.454963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:54.469436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463f5de-0994-47ca-a1c7-9b1cf298f1ad admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:54.560331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:54.562886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:54.563379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:54.563870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] PATH_INFO: `/v3/users/e10bedd5d26a4d3cadcd1f5c08358180` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:54.566084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10bedd5d26a4d3cadcd1f5c08358180)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:54.569771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:54.630441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10bedd5d26a4d3cadcd1f5c08358180'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.645050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10bedd5d26a4d3cadcd1f5c08358180'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.646367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10bedd5d26a4d3cadcd1f5c08358180'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.653689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10bedd5d26a4d3cadcd1f5c08358180'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.663376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-f4d08df9-401d-4896-8e58-c5279ae5c81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10bedd5d26a4d3cadcd1f5c08358180'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:54.671004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1037/2056] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:21:54 2022] DELETE /identity/v3/users/e10bedd5d26a4d3cadcd1f5c08358180 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:55.007742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.009223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:55.028273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c75cf-e52f-492c-9a37-fb47e77ba2a5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.116688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.118258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.118771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.119233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] PATH_INFO: `/v3/projects/f5e97b6e715341c787ccf312507059b2` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.121503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e97b6e715341c787ccf312507059b2)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.126159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.200103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e97b6e715341c787ccf312507059b2', 'request_id': 'req-01bb2ede-9b67-40e9-b863-ea907ad55a0c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:55.206529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e97b6e715341c787ccf312507059b2', 'request_id': 'req-01bb2ede-9b67-40e9-b863-ea907ad55a0c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:55.218156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e97b6e715341c787ccf312507059b2', 'request_id': 'req-01bb2ede-9b67-40e9-b863-ea907ad55a0c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:55.229843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] The token cache is being invalidate because project f5e97b6e715341c787ccf312507059b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:21:55.230153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:55.230794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01bb2ede-9b67-40e9-b863-ea907ad55a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:21:55.232375 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1020/2057] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:21:55 2022] DELETE /identity/v3/projects/f5e97b6e715341c787ccf312507059b2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:21:55.239121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100caf6-fded-4de8-8add-41527b28993c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.239668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100caf6-fded-4de8-8add-41527b28993c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.239983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100caf6-fded-4de8-8add-41527b28993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.273353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f100caf6-fded-4de8-8add-41527b28993c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:55.275497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f100caf6-fded-4de8-8add-41527b28993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:55.347178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1038/2058] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:55.356165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.357000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.357000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.378391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:55.379627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:55.388046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1021/2059] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:21:55.392818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100caf6-fded-4de8-8add-41527b28993c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.403530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100caf6-fded-4de8-8add-41527b28993c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.409397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.410149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.410427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.410718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.411473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:21:55.411782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.413555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.427850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1039/2060] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:21:55.434307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.453400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419c69d-1927-4c34-9369-9384a7a225cb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.461602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.462955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.463454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.464047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.465439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.470990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.515858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1022/2061] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:21:55 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:21:55.516988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.528534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c37837-7f17-482f-9e50-f64b0bea3deb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.619369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.620491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.621016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.621499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.623053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.628145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.656116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1040/2062] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:21:55 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:21:55.660459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.671282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ae949-0fa7-447b-9e83-a088d9fa2b9c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.676183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.676868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.677184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.677464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.678216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.679873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.694207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1023/2063] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:55.701589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.720743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0136ab2-4b51-436a-8dd7-4b709d58e1b5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.729590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.730961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.731563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.732343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.733573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.737036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a57ad-10e0-45d4-8c73-754b79bfb2de admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.760967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1041/2064] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:21:55.765806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.777640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c39e61-4b93-4e89-88a0-db2d3d01465b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:55.783918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:55.785103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.785401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.785882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] PATH_INFO: `/v3/projects/7deef946b4134d298ba4916987ac2d8f/users/ac74cfb4987344d78d987c542aca80d5/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.803493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7deef946b4134d298ba4916987ac2d8f, user_id=ac74cfb4987344d78d987c542aca80d5, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:55.807971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:55.830279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1024/2065] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:21:55 2022] PUT /identity/v3/projects/7deef946b4134d298ba4916987ac2d8f/users/ac74cfb4987344d78d987c542aca80d5/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:21:55.838363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff47f5-125f-4671-ab51-73fdc384ad14 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:55.838918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff47f5-125f-4671-ab51-73fdc384ad14 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:55.839426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff47f5-125f-4671-ab51-73fdc384ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:55.862924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-40ff47f5-125f-4671-ab51-73fdc384ad14 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:55.864172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-40ff47f5-125f-4671-ab51-73fdc384ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:55.939104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1042/2066] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:55.951407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:55.955270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:56.038899 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea5b7-ffc2-400a-a868-dd65c114f69e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:56.042772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:56.043442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:56.043754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:56.044119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:56.054884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:56.056443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:56.068287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1025/2067] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:21:56.861860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ef69-d6a8-4761-b39c-78f1a2b10cd8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:56.862442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ef69-d6a8-4761-b39c-78f1a2b10cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:56.862704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ef69-d6a8-4761-b39c-78f1a2b10cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:56.906766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a417ef69-d6a8-4761-b39c-78f1a2b10cd8 None None] MFA Rules not processed for user `ac74cfb4987344d78d987c542aca80d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:21:56.908186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a417ef69-d6a8-4761-b39c-78f1a2b10cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:56.990498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1043/2068] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:21:57.006915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:21:57.008524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:21:57.076452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e9892-5b99-44af-8360-82b7244b1903 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:21:57.080540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:21:57.081209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:21:57.081483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:21:57.081751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:21:57.091383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:21:57.094101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:21:57.106965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1026/2069] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:21:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:22:01.824214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a38ba-e2a9-4d63-90ad-143bc4d53a4a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:01.824699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a38ba-e2a9-4d63-90ad-143bc4d53a4a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:01.824802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a38ba-e2a9-4d63-90ad-143bc4d53a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:01.847485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-b91a38ba-e2a9-4d63-90ad-143bc4d53a4a None None] MFA Rules not processed for user `ac74cfb4987344d78d987c542aca80d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:01.848819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b91a38ba-e2a9-4d63-90ad-143bc4d53a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:01.858122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1044/2070] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:12.038328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:12.039837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:12.194619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1ff36-14aa-494f-8f18-8f7aaaa264b1 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:12.209960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:12.212697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:12.213574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:12.214314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] PATH_INFO: `/v3/users/51dc82438a534759986e05d9a73dfc24` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:12.218097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51dc82438a534759986e05d9a73dfc24)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:12.222058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:12.325427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51dc82438a534759986e05d9a73dfc24'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:12.329310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51dc82438a534759986e05d9a73dfc24'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:12.356378 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51dc82438a534759986e05d9a73dfc24'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:12.376585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51dc82438a534759986e05d9a73dfc24'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:12.377875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51dc82438a534759986e05d9a73dfc24'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:12.405023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1027/2071] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:22:12 2022] DELETE /identity/v3/users/51dc82438a534759986e05d9a73dfc24 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:22:12.411932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:12.417924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:12.418537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:12.485213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:12.487706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:12.572794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1045/2072] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:12.586589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:12.588551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:12.712916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c908ee-92a0-420f-b942-3ebf36e731f7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:12.718411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:12.719399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:12.719682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:12.719959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:12.732019 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:12.733730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4d6fd-460f-42e4-925e-43a99fc84339 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:12.744094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1028/2073] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:22:13.082928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.084682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:13.106282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63241435-b3b9-4e88-8b3f-c0f2d9d600a3 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.112009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.113064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.113287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.113617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] PATH_INFO: `/v3/projects/7dbd538edc0341b4ae0f80e57cb71332` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.115022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbd538edc0341b4ae0f80e57cb71332)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.117144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.194157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbd538edc0341b4ae0f80e57cb71332', 'request_id': 'req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:13.201950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbd538edc0341b4ae0f80e57cb71332', 'request_id': 'req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:13.212005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbd538edc0341b4ae0f80e57cb71332', 'request_id': 'req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:13.229278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] The token cache is being invalidate because project 7dbd538edc0341b4ae0f80e57cb71332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:22:13.229956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:13.230880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4a50ca6b-6078-46a0-b7ef-baccdbc1bb86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:13.233472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1046/2074] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:22:13 2022] DELETE /identity/v3/projects/7dbd538edc0341b4ae0f80e57cb71332 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:13.238645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.239294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.239294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.279552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:13.280748 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:13.361780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1029/2075] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:13.369953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.370452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.370876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.408670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:13.409990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:13.419018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1047/2076] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:13.424350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.437446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f3a21-ac9c-4284-9dac-eec8d7325a5d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.442788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.443597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.443966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.444325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.445140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:22:13.445457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.447215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.461980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1030/2077] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:22:13.468393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.479135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeeea9d-977b-4181-86d8-05ccd5b6a969 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.485121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.485827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.486111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.486395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.487155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.489367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.536473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1048/2078] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:22:13 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:22:13.541261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.555807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf199e-39b2-42c9-9166-219b83b3f775 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.655024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.656494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.656931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.657576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.658500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.661550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.699148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1031/2079] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:22:13 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:22:13.702186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.717093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167051c-0b69-4b64-b562-bbd9ef05480b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.722221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.722917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.723194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.723469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.724238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.725914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.742111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1049/2080] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:22:13.743538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.759478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3bc82-7065-46a4-87fa-0418cead3bb6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.768969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.770294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.770651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.770993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.772099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.774271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d2bab-1f02-4e6e-a514-d6aa42be7b02 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.787762 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1032/2081] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:22:13.793097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:13.809037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c16ffe-c425-4c99-bf0f-72f2f4fe8a45 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:13.816752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:13.818712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.819480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.819934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] PATH_INFO: `/v3/projects/08d5df8d5b1d45deaebbb1808312eabd/users/abd6f4cf263b494590ebca8c96149bd7/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.844787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d5df8d5b1d45deaebbb1808312eabd, user_id=abd6f4cf263b494590ebca8c96149bd7, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:13.847891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:13.867942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1050/2082] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:22:13 2022] PUT /identity/v3/projects/08d5df8d5b1d45deaebbb1808312eabd/users/abd6f4cf263b494590ebca8c96149bd7/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:13.879393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e17b5-76aa-4cc4-83bd-c86b4bff5bd5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:13.879691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e17b5-76aa-4cc4-83bd-c86b4bff5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:13.879929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e17b5-76aa-4cc4-83bd-c86b4bff5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:13.909308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6e8e17b5-76aa-4cc4-83bd-c86b4bff5bd5 None None] MFA Rules not processed for user `abd6f4cf263b494590ebca8c96149bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:13.910491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6e8e17b5-76aa-4cc4-83bd-c86b4bff5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:13.984699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1033/2083] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:14.000628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:14.002394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:14.067345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a576df-c50c-4839-807a-0b4d27547b6a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:14.072844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:14.074002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:14.074493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:14.075003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:14.090935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:14.093421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:14.103441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1051/2084] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:22:14.771459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee276a-ee2b-432d-8653-ca66cca006ec None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:14.771920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee276a-ee2b-432d-8653-ca66cca006ec None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:14.772005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee276a-ee2b-432d-8653-ca66cca006ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:14.792126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-39ee276a-ee2b-432d-8653-ca66cca006ec None None] MFA Rules not processed for user `a2f544b022f84fb291d0794dca05788d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:14.793388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-39ee276a-ee2b-432d-8653-ca66cca006ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:14.875538 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1034/2085] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:15.870835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:15.873897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:16.042193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5ae48-5842-45be-9cce-310aebd2492b service glance] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:16.050309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:16.052179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:16.052744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:16.053210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] PATH_INFO: `/v3/users/c5f5f6823db646efa99c39447c740687` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:16.055435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f5f6823db646efa99c39447c740687)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:16.057509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:16.133100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f5f6823db646efa99c39447c740687'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:16.148394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f5f6823db646efa99c39447c740687'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:16.149221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f5f6823db646efa99c39447c740687'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:16.162862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f5f6823db646efa99c39447c740687'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:16.174522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f5f6823db646efa99c39447c740687'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:16.182966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1052/2086] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:22:15 2022] DELETE /identity/v3/users/c5f5f6823db646efa99c39447c740687 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:16.189163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:16.189738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:16.190127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:16.227314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:16.228827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:16.323551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1035/2087] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:16.332572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:16.334901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:16.434530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a42ad2-8913-4162-9412-d3b06778e5e5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:16.440054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:16.441049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:16.441342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:16.441625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:16.454780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:16.456523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4dd3-8497-4a77-8292-2248627bbd38 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:16.469154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1053/2088] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:22:16.933206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:16.935271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:16.953186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4208f-385e-4d56-aee7-b74c936860b8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:16.963967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:16.969206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:16.969505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:16.969818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] PATH_INFO: `/v3/projects/6e4a235605e74719ab6090eea7a10458` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:16.971205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4a235605e74719ab6090eea7a10458)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:16.973807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.051396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4a235605e74719ab6090eea7a10458', 'request_id': 'req-adbfb72e-3e96-43be-89ab-8a1089ba1940'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:17.069841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4a235605e74719ab6090eea7a10458', 'request_id': 'req-adbfb72e-3e96-43be-89ab-8a1089ba1940'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:17.087846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4a235605e74719ab6090eea7a10458', 'request_id': 'req-adbfb72e-3e96-43be-89ab-8a1089ba1940'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:17.112999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] The token cache is being invalidate because project 6e4a235605e74719ab6090eea7a10458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:22:17.113341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:17.114128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-adbfb72e-3e96-43be-89ab-8a1089ba1940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:17.116361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1036/2089] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:22:16 2022] DELETE /identity/v3/projects/6e4a235605e74719ab6090eea7a10458 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:17.123963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.125385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.125770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.167259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:17.168480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:17.288845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1054/2090] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:22:17.296331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.297877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.298420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.330607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:17.332763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:17.347499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1037/2091] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:17.359015 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.374142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c63e-4f8b-4ec1-b527-88ded227d73d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.379185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.379976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.380261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.380631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.381512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:22:17.381886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.383790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.398442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1055/2092] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:22:17.402733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.414280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e24642-d387-433c-b99a-cf53df0f2a5c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.421961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.423044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.423481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.423880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.424872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.428153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.460414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1038/2093] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:22:17 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:22:17.466077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.482034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee860500-1662-4c92-9eed-c01c4cbda821 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.583223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.584293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.584795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.585327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.586945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.591080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.635411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1056/2094] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:22:17 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:22:17.637840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.666278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf7d5a-bfe3-4c7d-85ec-b6f9496347b5 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.675299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.676664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.677303 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.677878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.679395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.682593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.712014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1039/2095] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:22:17.714979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.735921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897bdd-5692-4b4c-9b2c-72fe8d2df369 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.745076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.746703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.751661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.751661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.751661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.752843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fed1a-d5ac-48ba-8361-9fe2bb0d69ec admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.799970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1057/2096] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:22:17.808231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.829456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe9e88-3c6d-41ff-a5b9-4545fcfac21a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:17.834967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:17.835871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.836227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.836507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] PATH_INFO: `/v3/projects/78b53aed61c64871a933fa120d337481/users/2294d1ced66e410888096922d8185370/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.857284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b53aed61c64871a933fa120d337481, user_id=2294d1ced66e410888096922d8185370, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:17.861297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:17.891092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1040/2097] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:22:17 2022] PUT /identity/v3/projects/78b53aed61c64871a933fa120d337481/users/2294d1ced66e410888096922d8185370/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:17.902989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:17.903342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:17.903651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:17.961301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:17.965942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.005339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] MFA Rules not processed for user `2294d1ced66e410888096922d8185370`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:18.008765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.119974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75029af-9117-4cde-876c-49d2c9456833 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:18.133388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1058/2098] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:18.143806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:18.144880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:18.145881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:18.146234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:18.146581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] PATH_INFO: `/v3/users/cfde254fd9204b03bc3881d4cd713daf` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:18.146854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.151066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfde254fd9204b03bc3881d4cd713daf)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:18.155259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:18.221682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfde254fd9204b03bc3881d4cd713daf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:18.222558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfde254fd9204b03bc3881d4cd713daf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:18.246095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfde254fd9204b03bc3881d4cd713daf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:18.257493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfde254fd9204b03bc3881d4cd713daf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:18.258605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-53fa8599-8f4e-4a32-975c-bfb0bf13c2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfde254fd9204b03bc3881d4cd713daf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:18.260621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9f36-e017-4e2f-9453-e3376ed17532 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:18.273077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:18.273885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:18.274247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:18.274542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:18.278956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.279793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1041/2099] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:22:17 2022] DELETE /identity/v3/users/cfde254fd9204b03bc3881d4cd713daf => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:18.286048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:18.286713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:18.287109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:18.301873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:18.303479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:18.320704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1059/2100] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:22:18.330854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:18.332416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.422340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1042/2101] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:18.441790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:18.443367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:18.543415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c6-ac14-45dc-9a1e-6a06b00311c8 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:18.625809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:18.626628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:18.627007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:18.627381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:18.643074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:18.644726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc1d8a-e590-43da-ae7e-151c00ecb28f service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:18.663697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1060/2102] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:22:19.056058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:19.057704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:19.073073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b15e4d-60b0-4458-a2a4-1e35af5b55a2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:19.090617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:19.092521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:19.092521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:19.092521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] PATH_INFO: `/v3/projects/e4f777797b974fe0a5312227bf9131d6` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:19.094721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f777797b974fe0a5312227bf9131d6)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:19.097545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:19.165777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f777797b974fe0a5312227bf9131d6', 'request_id': 'req-1d34de4b-10ed-4cb9-b595-db839c35926e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:19.174155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f777797b974fe0a5312227bf9131d6', 'request_id': 'req-1d34de4b-10ed-4cb9-b595-db839c35926e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:19.182110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f777797b974fe0a5312227bf9131d6', 'request_id': 'req-1d34de4b-10ed-4cb9-b595-db839c35926e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:19.195312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] The token cache is being invalidate because project e4f777797b974fe0a5312227bf9131d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:22:19.195603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:19.196360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d34de4b-10ed-4cb9-b595-db839c35926e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:19.198102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1043/2103] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:22:19 2022] DELETE /identity/v3/projects/e4f777797b974fe0a5312227bf9131d6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:20.935074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:20.935876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:20.935876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:20.954268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] MFA Rules not processed for user `2294d1ced66e410888096922d8185370`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:20.955533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:21.014963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1061/2104] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:28.616339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37c49-b05a-41af-8684-b72d5519886c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:28.617485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37c49-b05a-41af-8684-b72d5519886c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:28.617904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d37c49-b05a-41af-8684-b72d5519886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:28.640954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-61d37c49-b05a-41af-8684-b72d5519886c None None] MFA Rules not processed for user `ac74cfb4987344d78d987c542aca80d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:28.642825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-61d37c49-b05a-41af-8684-b72d5519886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:28.735941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1044/2105] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:41.767202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:41.768765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:41.936660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e58ef-038c-42a4-8c32-883204cf60a8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:41.943819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:41.944548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:41.944774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:41.945130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:41.947240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:41.968607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:41.970523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:41.990818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1062/2106] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:22:43.965187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dff4-8613-4a08-8045-88f74c7a1a66 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:43.965769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dff4-8613-4a08-8045-88f74c7a1a66 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:43.965947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253dff4-8613-4a08-8045-88f74c7a1a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:44.001048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-6253dff4-8613-4a08-8045-88f74c7a1a66 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:44.002198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6253dff4-8613-4a08-8045-88f74c7a1a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:44.083466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1045/2107] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:22:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:44.138988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:44.140475 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:44.214105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f96dfaa-6ba7-4950-a5af-430f0c9f9fa7 service placement] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:44.220852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:44.221568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:44.222002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:44.222306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:44.232870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:44.234718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:44.243505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1063/2108] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:22:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:22:44.913739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e168e0-ce61-4e63-8e44-911713864582 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:44.914044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e168e0-ce61-4e63-8e44-911713864582 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:44.914326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e168e0-ce61-4e63-8e44-911713864582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:44.932139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-34e168e0-ce61-4e63-8e44-911713864582 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:44.933470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-34e168e0-ce61-4e63-8e44-911713864582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:44.940808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1046/2109] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:44.959345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:44.971177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1878-377d-4f79-ae33-3d655ba968fd service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:44.977820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:44.978475 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:44.978757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:44.979030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:44.989030 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:44.990628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:45.003650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1064/2110] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:22:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:22:45.261128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69076db3-97b2-4d90-83f3-0ee37f0c25a7 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:45.261962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69076db3-97b2-4d90-83f3-0ee37f0c25a7 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:45.262119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69076db3-97b2-4d90-83f3-0ee37f0c25a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:45.283189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-69076db3-97b2-4d90-83f3-0ee37f0c25a7 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:45.284312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-69076db3-97b2-4d90-83f3-0ee37f0c25a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:45.291970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1047/2111] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:45.304373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:45.317643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834616-9306-42ff-8f75-de20516c1a02 service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:45.323170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:45.323852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:45.324137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:45.324416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:45.334628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:45.336221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:45.345661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1065/2112] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:22:45.707450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:45.708236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:45.708701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:45.739301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:45.740690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:45.756272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1048/2113] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:22:45.778543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:45.805369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca1bb-8b71-4084-8c16-20469cb9777d service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:45.814530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:45.816025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:45.816776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:45.817390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:45.834478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:45.838026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625fc52-c91e-43a5-9e14-ae1007695b1c service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:45.854445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1066/2114] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:22:56.406984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:56.408449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:56.475661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b6b34-4d81-4cd6-aad8-ecec1cfee48f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:56.480337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:56.481259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:56.481537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:56.481804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] PATH_INFO: `/v3/users/2294d1ced66e410888096922d8185370` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:56.483155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2294d1ced66e410888096922d8185370)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:56.485432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:56.541864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2294d1ced66e410888096922d8185370'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:56.542591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2294d1ced66e410888096922d8185370'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:56.555171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2294d1ced66e410888096922d8185370'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:56.563974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2294d1ced66e410888096922d8185370'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:56.564734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2294d1ced66e410888096922d8185370'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:56.580533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1049/2115] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:22:56 2022] DELETE /identity/v3/users/2294d1ced66e410888096922d8185370 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:56.585344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:56.585879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:56.586033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:56.604566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:56.605778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:56.682651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1067/2116] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:56.693703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:56.695186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:56.769511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc4a9a-8d08-4c74-a50b-93280f3c9e1f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:56.774123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:56.774884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:56.775173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:56.775453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:56.788687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:56.791731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afef394-0373-494f-ba1e-759dc0579ab7 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:56.807888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1050/2117] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:22:57.034509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.036375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:57.052196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0dd83d-49dc-47b2-97cf-0d75c9307a16 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.059135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.063909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.064610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.066759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] PATH_INFO: `/v3/projects/78b53aed61c64871a933fa120d337481` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.070948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b53aed61c64871a933fa120d337481)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.073612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.143888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b53aed61c64871a933fa120d337481', 'request_id': 'req-e1e03a96-e998-4330-8a44-3ead2fb5122f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:57.150369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b53aed61c64871a933fa120d337481', 'request_id': 'req-e1e03a96-e998-4330-8a44-3ead2fb5122f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:57.160516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b53aed61c64871a933fa120d337481', 'request_id': 'req-e1e03a96-e998-4330-8a44-3ead2fb5122f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:57.175913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] The token cache is being invalidate because project 78b53aed61c64871a933fa120d337481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:22:57.176210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:57.176882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e1e03a96-e998-4330-8a44-3ead2fb5122f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:22:57.178774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1068/2118] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:22:57 2022] DELETE /identity/v3/projects/78b53aed61c64871a933fa120d337481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:22:57.184629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.185187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.185307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.227769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:57.229124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:57.306797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1051/2119] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:57.314605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.314890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.315166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.333738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:57.334914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:57.343722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1069/2120] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:57.347921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.358693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08456a-aab5-495d-8d1d-99f9da5f18ad None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.363850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.364517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.364876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.365198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.366564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:22:57.366564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.367869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.380955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1052/2121] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:22:57.385410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.395174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5818036-2c90-4fc9-9bda-d78b65b3f254 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.400002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.400671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.401018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.401292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.402000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.403937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.430472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1070/2122] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:22:57 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:22:57.434869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.445090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e92ee5-21eb-493c-87e1-ee705371e729 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.507561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.508151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.508437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.508716 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.509480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.511414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.533613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1053/2123] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:22:57 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:22:57.537201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.547791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f6d7e-7b8a-4717-8251-8701f2de15db admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.552523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.553221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.553494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.553772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.554512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.556104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.567777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1071/2124] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:22:57.571811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.583117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4e052-7e16-46b8-a366-c8760f05deb2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.588641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.590075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.590362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.590644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.591390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.593514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77aae0-d5e8-4b36-923e-6aa1850ba373 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.604839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1054/2125] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:22:57.612261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.622905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097b3d-1b85-479c-929f-b009edc7718b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.628653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.629591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.629902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.630174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] PATH_INFO: `/v3/projects/b58d87f4f4ed448f8d45c85f92cf1462/users/94835c1fe2b64e06b994878d1143ed54/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.645664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58d87f4f4ed448f8d45c85f92cf1462, user_id=94835c1fe2b64e06b994878d1143ed54, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.648347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.663285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1072/2126] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:22:57 2022] PUT /identity/v3/projects/b58d87f4f4ed448f8d45c85f92cf1462/users/94835c1fe2b64e06b994878d1143ed54/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:22:57.669940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.671114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.671573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.694037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:22:57.695492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:57.766207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1055/2127] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:22:57.776069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:22:57.778546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:22:57.841650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6add02-d881-4f0a-8785-d4a361082f9e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:22:57.848917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:22:57.849863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:22:57.850304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:22:57.850735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:22:57.862560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:22:57.864000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9379a2-d8d9-481f-aeb0-82e970d81e81 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:22:57.874137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1073/2128] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:22:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:23:00.654388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:00.663448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:00.680618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c4598-ce9d-4d34-906b-02c3a78ddca6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:00.688693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:00.689684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:00.689913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:00.690193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] PATH_INFO: `/v3/users/abd6f4cf263b494590ebca8c96149bd7` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:00.694590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd6f4cf263b494590ebca8c96149bd7)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:00.696749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:00.774478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd6f4cf263b494590ebca8c96149bd7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:00.775239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd6f4cf263b494590ebca8c96149bd7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:00.797953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd6f4cf263b494590ebca8c96149bd7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:00.807194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd6f4cf263b494590ebca8c96149bd7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:00.808359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd6f4cf263b494590ebca8c96149bd7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:00.849355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1056/2129] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:00 2022] DELETE /identity/v3/users/abd6f4cf263b494590ebca8c96149bd7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:00.857442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:00.858719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:00.859375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:00.898263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:00.899486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:01.032663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1074/2130] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:01.043343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:01.046633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:01.155531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a5159-0b54-458a-9367-7810c3b91c3c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:01.167142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:01.167871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:01.168162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:01.172481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:01.190382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:01.193436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341f480-0f82-43ec-a0cf-938958ed4cba service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:01.211334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1057/2131] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:23:01.848986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:01.850621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:01.867366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee02612-a688-48f7-9521-068843df1ca6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:01.875751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:01.877032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:01.877592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:01.877944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] PATH_INFO: `/v3/projects/08d5df8d5b1d45deaebbb1808312eabd` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:01.880220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d5df8d5b1d45deaebbb1808312eabd)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:01.882940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:01.967135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d5df8d5b1d45deaebbb1808312eabd', 'request_id': 'req-077ffab3-e7a5-4814-80a0-618ed6956f66'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:01.979772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d5df8d5b1d45deaebbb1808312eabd', 'request_id': 'req-077ffab3-e7a5-4814-80a0-618ed6956f66'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:01.993770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d5df8d5b1d45deaebbb1808312eabd', 'request_id': 'req-077ffab3-e7a5-4814-80a0-618ed6956f66'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:02.007789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] The token cache is being invalidate because project 08d5df8d5b1d45deaebbb1808312eabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:02.008138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:02.008819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-077ffab3-e7a5-4814-80a0-618ed6956f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:02.014205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1075/2132] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:01 2022] DELETE /identity/v3/projects/08d5df8d5b1d45deaebbb1808312eabd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:02.016725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.017293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.017711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.063419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:02.066191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:02.194867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1058/2133] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:02.205562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.206324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.206324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.276069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:02.281759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:02.305660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1076/2134] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:02.309924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.339177 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82859b8-1909-4b6b-853f-3b940bce118d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.351457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.352415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.352857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.355277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.356291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:23:02.356750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.359657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.381338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1059/2135] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:23:02.386610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.405347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd341b4-7b6c-4cb8-bc6b-90d18dee6935 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.418121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.419959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.420727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.421386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.422187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.427002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.492394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1077/2136] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:02 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:02.493567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.506265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9179e-185d-495f-8026-96a4efd4fbce admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.634093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.635794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.636201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.636578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.637439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.642259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.688365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1060/2137] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:02 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:02.694035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.719589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c93bdc-9acf-44ee-9549-01b30ade6827 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.725627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.726329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.726580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.726853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.727644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.729395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.746466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1078/2138] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:02.749473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.762680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7b60-7d99-4d6c-a9af-9ea3c6ebbd10 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.770239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.771272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.771770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.772298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.773436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.775518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ffc3f-79f9-43bd-8ffa-7e6e6935d9a2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.797409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:02.811424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1061/2139] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:02.813466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3cffa-7963-49c1-babb-d16fef1007d5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:02.826180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:02.828922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.829336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.831269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] PATH_INFO: `/v3/projects/1ba3b5e2169b40148cfb3daa6fb61162/users/956bd79de25a40aca93e520cfaa296bd/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.867699 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba3b5e2169b40148cfb3daa6fb61162, user_id=956bd79de25a40aca93e520cfaa296bd, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:02.873427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:02.897355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1079/2140] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:02 2022] PUT /identity/v3/projects/1ba3b5e2169b40148cfb3daa6fb61162/users/956bd79de25a40aca93e520cfaa296bd/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:02.903273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211e6a-10a6-4f78-b4bf-ad6a5709f729 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:02.915760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211e6a-10a6-4f78-b4bf-ad6a5709f729 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:02.916008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50211e6a-10a6-4f78-b4bf-ad6a5709f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:02.957747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-50211e6a-10a6-4f78-b4bf-ad6a5709f729 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:02.959377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-50211e6a-10a6-4f78-b4bf-ad6a5709f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:03.056158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1062/2141] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:03.069128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:03.073305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:03.193812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3c6c70-8581-44f5-9b76-5fe42323ecfc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:03.199161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:03.201983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:03.202523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:03.202969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:03.249215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:03.250988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:03.280377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1080/2142] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:23:03.983783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:03.984069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:03.984657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.019483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] MFA Rules not processed for user `94835c1fe2b64e06b994878d1143ed54`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:04.020777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:04.117715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1063/2143] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:04.124504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.127307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:04.144288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a432f-b93c-4e92-864c-ad4ff2c95213 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.150151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.150837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.151122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.151403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.152150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.155634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.221953 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1081/2144] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:04 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:04.225453 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.242780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d92995-fefc-4aa5-9909-ca5dced8d73c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.341415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.351468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.352101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.352577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.353590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.355838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.384032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1064/2145] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:04 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:04.388109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.401171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aef4150-47e1-456b-afc0-d76dd36a570a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.407899 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.409020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.412091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.412803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.413823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.415761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.431038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1082/2146] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:04.435492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.447259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7918406-c3e1-468b-a1e9-62b82d7aef06 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.452676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.454091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.454374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.454689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] PATH_INFO: `/v3/projects/5c921988dc0e498399aeb62635a46c48/users/b512eeb2038b430981f2a4bb3ad3cdab/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.480733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c921988dc0e498399aeb62635a46c48, user_id=b512eeb2038b430981f2a4bb3ad3cdab, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.487146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b33913-cf76-47a0-9070-02c44f34938f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.510210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1065/2147] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:04 2022] PUT /identity/v3/projects/5c921988dc0e498399aeb62635a46c48/users/b512eeb2038b430981f2a4bb3ad3cdab/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:04.517263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.537653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4c43-ac4f-42e5-8eca-3c4d21bae0b6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.631774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f541a-6d8e-4762-b336-140df6ae3c03 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.632064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f541a-6d8e-4762-b336-140df6ae3c03 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.632350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f541a-6d8e-4762-b336-140df6ae3c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.636208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.637701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.638338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.639713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.641625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.645005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.664291 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-470f541a-6d8e-4762-b336-140df6ae3c03 None None] MFA Rules not processed for user `956bd79de25a40aca93e520cfaa296bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:04.665540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-470f541a-6d8e-4762-b336-140df6ae3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:04.668972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1083/2148] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:04.674399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.694922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033a22d-f6c1-4bd5-b559-aa13df836eef admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.704199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.706068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.706864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.707450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] PATH_INFO: `/v3/projects/5c921988dc0e498399aeb62635a46c48/users/b512eeb2038b430981f2a4bb3ad3cdab/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:04.711823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c921988dc0e498399aeb62635a46c48, user_id=b512eeb2038b430981f2a4bb3ad3cdab, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:04.723600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:04.738957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1084/2149] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:04 2022] PUT /identity/v3/projects/5c921988dc0e498399aeb62635a46c48/users/b512eeb2038b430981f2a4bb3ad3cdab/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:04.776966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1066/2150] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:04.794320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:04.797175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:04.917387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38e149-0f8b-431d-8e14-badbb44aa30a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:04.921709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:04.922482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:04.922799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:04.923045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:05.022364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:05.023986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:05.037577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1085/2151] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:23:10.088564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c3ef-b340-4a80-a47d-9e5a1dd394d9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:10.089154 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c3ef-b340-4a80-a47d-9e5a1dd394d9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:10.089459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6c3ef-b340-4a80-a47d-9e5a1dd394d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:10.152956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8de6c3ef-b340-4a80-a47d-9e5a1dd394d9 None None] MFA Rules not processed for user `b512eeb2038b430981f2a4bb3ad3cdab`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:10.154230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8de6c3ef-b340-4a80-a47d-9e5a1dd394d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:10.290790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1067/2152] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:10.303573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:10.305229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:10.409149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47492df4-6ebc-4393-8618-71c5a0f8e357 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:10.413307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:10.413977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:10.414262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:10.414543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:10.504250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:10.505797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:10.516624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1086/2153] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:23:10.663259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1853021-08dc-4795-bc40-134f72cdb987 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:10.663545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1853021-08dc-4795-bc40-134f72cdb987 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:10.663848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1853021-08dc-4795-bc40-134f72cdb987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:10.728416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b1853021-08dc-4795-bc40-134f72cdb987 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:10.729844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b1853021-08dc-4795-bc40-134f72cdb987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:10.832543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1068/2154] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:23:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:10.846265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:10.847754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:10.939464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbce15-d1d3-455c-94f9-b87470f90a04 service glance] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:10.944785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:10.945463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:10.945874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:10.946159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:10.956297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:10.958073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:10.968011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1087/2155] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:11.272456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81afa-3d47-4ef4-8836-1f6cc3d94261 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:11.274564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81afa-3d47-4ef4-8836-1f6cc3d94261 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:11.274917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a81afa-3d47-4ef4-8836-1f6cc3d94261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:11.313913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b7a81afa-3d47-4ef4-8836-1f6cc3d94261 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:11.315390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b7a81afa-3d47-4ef4-8836-1f6cc3d94261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:11.329169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1069/2156] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:23:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:11.365415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:11.390332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020fd82-ccab-47ba-bead-351937014567 service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:11.405301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:11.406744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:11.407173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:11.408115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:11.452050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:11.454136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfabe0fd-f8e4-4ea8-9acf-462ad2b5b3ac service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:11.474044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1088/2157] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:23:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:12.168715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade7f9-9f7f-44f9-978e-b24f76fb3da8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:12.170080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade7f9-9f7f-44f9-978e-b24f76fb3da8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:12.170376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade7f9-9f7f-44f9-978e-b24f76fb3da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:12.205394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-5bade7f9-9f7f-44f9-978e-b24f76fb3da8 None None] MFA Rules not processed for user `956bd79de25a40aca93e520cfaa296bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:12.218118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5bade7f9-9f7f-44f9-978e-b24f76fb3da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:12.251820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1070/2158] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:25.798581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:25.799508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:25.800139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:25.839460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] MFA Rules not processed for user `94835c1fe2b64e06b994878d1143ed54`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:25.841960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:25.850359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1089/2159] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:29.571885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c710c3-48dd-4d0b-b47c-9c9ed586964d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:29.572485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c710c3-48dd-4d0b-b47c-9c9ed586964d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:29.572485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c710c3-48dd-4d0b-b47c-9c9ed586964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:29.640073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e2c710c3-48dd-4d0b-b47c-9c9ed586964d None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:29.642105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e2c710c3-48dd-4d0b-b47c-9c9ed586964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:29.659759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1071/2160] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:23:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:29.787311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:29.812938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab4a2c-9f48-4674-a01b-0f2679984ca5 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:29.829929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:29.835124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:29.836173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:29.837018 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:29.866971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:29.871376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:29.883779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1090/2161] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:23:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:35.155482 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:35.157044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:35.157044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:35.180859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:35.182524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:35.204394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1072/2162] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:23:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:35.244230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:35.260928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba7a15-c7b0-4fa7-89fd-6dbee9ba6bcc service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:35.270144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:35.270770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:35.271049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:35.271337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:35.284757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:35.310187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:35.316733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1091/2163] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:23:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:23:37.991358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:37.993525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:38.113226 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2b3f8-81ce-4a99-ab7d-fc3fc866d1bf None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:38.123488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:38.127551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.127551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.127551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] PATH_INFO: `/v3/users/ac74cfb4987344d78d987c542aca80d5` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.127551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac74cfb4987344d78d987c542aca80d5)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:38.129520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:38.191333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac74cfb4987344d78d987c542aca80d5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.192130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac74cfb4987344d78d987c542aca80d5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.204831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac74cfb4987344d78d987c542aca80d5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.212616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac74cfb4987344d78d987c542aca80d5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.213363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7c5ea21d-034e-4ce1-a156-2f38ccd99669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac74cfb4987344d78d987c542aca80d5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.234120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1073/2164] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:37 2022] DELETE /identity/v3/users/ac74cfb4987344d78d987c542aca80d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:38.425568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:38.440936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a43c8c-dff6-4667-8be8-dbcf5d9b4621 service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:38.544026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:38.545510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.546074 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.546532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] PATH_INFO: `/v3/projects/7deef946b4134d298ba4916987ac2d8f` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.548307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7deef946b4134d298ba4916987ac2d8f)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:38.551341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:38.611662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7deef946b4134d298ba4916987ac2d8f', 'request_id': 'req-0660f74c-eee3-4ce1-9659-a649b025f1f7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.623980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7deef946b4134d298ba4916987ac2d8f', 'request_id': 'req-0660f74c-eee3-4ce1-9659-a649b025f1f7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.633841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7deef946b4134d298ba4916987ac2d8f', 'request_id': 'req-0660f74c-eee3-4ce1-9659-a649b025f1f7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.652804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] The token cache is being invalidate because project 7deef946b4134d298ba4916987ac2d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:38.653222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.653900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0660f74c-eee3-4ce1-9659-a649b025f1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:38.655875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1092/2165] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:38 2022] DELETE /identity/v3/projects/7deef946b4134d298ba4916987ac2d8f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:38.660687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.661036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.661283 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.689155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:38.690384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:38.769098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1074/2166] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:38.777424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.777841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.778321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.800956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:38.802330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:38.812650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1093/2167] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:38.816631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:38.828957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf021d7-8334-4ffd-9f33-b5851b9392d0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:38.834645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:38.835339 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.835628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.835904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.836668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:23:38.837027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:38.838702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:38.858209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1075/2168] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:23:38.858910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:38.868929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5638066-7adf-4d35-bbd7-8897c1841733 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:38.874590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:38.875252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:38.875531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:38.875803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:38.876512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:38.878469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:38.927918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1094/2169] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:38 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:23:38.929380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:38.948128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6fe4b7-7f9b-415c-a735-941282f89efa admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:39.040342 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:39.041455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.041573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.041851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.042741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:39.045900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:39.088222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1076/2170] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:38 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:39.095684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:39.114399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5845a0-0cf0-465f-a720-500118e8999e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:39.136462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:39.137402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.138065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.138065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.139117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:39.140875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:39.152669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1095/2171] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:39.158215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:39.168642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f3a5-2946-40b2-8ca3-d8ea2b574f91 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:39.191093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:39.191774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.192060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.192337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.193157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:39.195103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a673-5268-4a70-85b3-939d181f6337 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:39.210400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1077/2172] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:39.214789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:39.227060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b89980-586c-46bd-a605-bb094a6b58c3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:39.233995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:39.234826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.235051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.235329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] PATH_INFO: `/v3/projects/89374c3ea86d4cb5bbbf3eede14da634/users/ca4f6bc1557a4126acb734abaab43919/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.264883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89374c3ea86d4cb5bbbf3eede14da634, user_id=ca4f6bc1557a4126acb734abaab43919, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:39.267821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:39.286813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1096/2173] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:39 2022] PUT /identity/v3/projects/89374c3ea86d4cb5bbbf3eede14da634/users/ca4f6bc1557a4126acb734abaab43919/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:39.303820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.304209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.304601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.346421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] MFA Rules not processed for user `ca4f6bc1557a4126acb734abaab43919`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:39.352466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:39.456286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1078/2174] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:39.469047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:39.471943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:39.578446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d371-ee7e-4fdf-9f27-99ab25f258b6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:39.587068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:39.587813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:39.588163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:39.588442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:39.613982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:39.615329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:39.634329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1097/2175] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:23:51.817299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:51.871669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:51.874396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:51.941630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fed59-5bc1-4ca4-a572-6369f62dcd51 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:51.952193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:51.953981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:51.956624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:51.957058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] PATH_INFO: `/v3/users/ca4f6bc1557a4126acb734abaab43919` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:51.960284 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4f6bc1557a4126acb734abaab43919)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:51.962811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.045530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4f6bc1557a4126acb734abaab43919'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.046343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4f6bc1557a4126acb734abaab43919'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.048128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06843b-6ee9-4bcb-9286-d9af05b12b05 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:52.057539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:52.058615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.059064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.059423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] PATH_INFO: `/v3/users/a2f544b022f84fb291d0794dca05788d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.061361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f544b022f84fb291d0794dca05788d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:52.063564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.064800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4f6bc1557a4126acb734abaab43919'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.073687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4f6bc1557a4126acb734abaab43919'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.074450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4e83b863-31d5-4d8f-8f48-565cbb3f621d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4f6bc1557a4126acb734abaab43919'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.110473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1079/2176] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:51 2022] DELETE /identity/v3/users/ca4f6bc1557a4126acb734abaab43919 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:52.118948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.120217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.124966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.167083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f544b022f84fb291d0794dca05788d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.167941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:52.171193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.194547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f544b022f84fb291d0794dca05788d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.196166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f544b022f84fb291d0794dca05788d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.215985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f544b022f84fb291d0794dca05788d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.234650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f544b022f84fb291d0794dca05788d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.257043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1098/2177] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:51 2022] DELETE /identity/v3/users/a2f544b022f84fb291d0794dca05788d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:52.360789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1080/2178] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:52.376143 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:52.377711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.443240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa13236-18f7-4a88-8d82-4f715c0d6ac5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:52.447532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:52.448199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.448485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.448764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.516694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:52.518558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.535026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:52.536435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e02d0d-b628-47d9-b25e-ca1ed0ef98bb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:52.536597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ffdba-b620-4ae6-900b-22b5b5f8e195 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.542167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:52.544984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.544984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.544984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] PATH_INFO: `/v3/projects/3d7002e2df35463c9128baa00359cd9e` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.546069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7002e2df35463c9128baa00359cd9e)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:52.548273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.550758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1099/2179] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:23:52.623988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7002e2df35463c9128baa00359cd9e', 'request_id': 'req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.632890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7002e2df35463c9128baa00359cd9e', 'request_id': 'req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.643490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7002e2df35463c9128baa00359cd9e', 'request_id': 'req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.659700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] The token cache is being invalidate because project 3d7002e2df35463c9128baa00359cd9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:52.659983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.660709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-792bc97e-eb6d-4ec5-9c57-5dcf8111d32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:52.663876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1081/2180] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:52 2022] DELETE /identity/v3/projects/3d7002e2df35463c9128baa00359cd9e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:52.670649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.671494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.671904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.697862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:52.700740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.813978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1100/2181] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:52.815562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.815856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.816210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.844499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:52.845940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.862637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1082/2182] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:52.864467 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:52.881336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdba5f0-2508-4751-8338-0c6b7a0e9c89 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:52.891179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:52.892501 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.893045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.893513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.894995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:23:52.895555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:52.898769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.919389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1101/2183] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:23:52.920908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:52.940977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c94e58-2127-4842-9211-6a2628141e58 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:52.952367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:52.953153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:52.953428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:52.954062 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:52.954846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:52.957876 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:52.976735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:52.979004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:52.994287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1083/2184] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:52 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:52.995039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54d70-ccf1-4baa-bf18-50b80842f35a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.000065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.080290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.082001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.082412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.082781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] PATH_INFO: `/v3/projects/89374c3ea86d4cb5bbbf3eede14da634` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.084302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89374c3ea86d4cb5bbbf3eede14da634)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.086326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.110092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713bed7-e9ab-4e56-842b-8326cae4198a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.115330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.116028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.116309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.116771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.117829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.120683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.182788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1084/2185] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:52 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:53.183025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89374c3ea86d4cb5bbbf3eede14da634', 'request_id': 'req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:53.190981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89374c3ea86d4cb5bbbf3eede14da634', 'request_id': 'req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:53.196533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.205069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89374c3ea86d4cb5bbbf3eede14da634', 'request_id': 'req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:53.221039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daabcc-0d96-43f3-97d9-4e955bcd4ee7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.222090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] The token cache is being invalidate because project 89374c3ea86d4cb5bbbf3eede14da634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:53.222397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:53.223307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:53.226723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1102/2186] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:52 2022] DELETE /identity/v3/projects/89374c3ea86d4cb5bbbf3eede14da634 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:53.439547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.440340 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.440557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.440828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.442416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.444144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.462118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1085/2187] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:53.466559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.468219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:53.483538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52829f-146e-4ee3-8a7f-9d1bb9b992f9 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.488788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.489570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.489853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.490138 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.491142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.492974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60009ef-5da6-4c85-80a0-437ff2622f86 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.512654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1103/2188] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:23:53.514151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.537198 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcd05d-8fd4-47ac-a417-868f0d828c19 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.547644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.548972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.549469 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.549990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] PATH_INFO: `/v3/projects/1f56c4b38c3644bd98b97ce88febffc5/users/80530ee512b246e4aac3bb9052291bb4/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.579757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f56c4b38c3644bd98b97ce88febffc5, user_id=80530ee512b246e4aac3bb9052291bb4, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.582989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.606486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1086/2189] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:53 2022] PUT /identity/v3/projects/1f56c4b38c3644bd98b97ce88febffc5/users/80530ee512b246e4aac3bb9052291bb4/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:53.617729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.618091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.618348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.659228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] MFA Rules not processed for user `80530ee512b246e4aac3bb9052291bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:53.660571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:53.758205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1104/2190] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:53.763272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.843119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71b4a-95dc-4ce1-b146-7a53fd4e9013 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.848230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.849075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.849544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.849900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.850772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.853016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:53.890776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1087/2191] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:53 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:53.896426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:53.912117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8520e4-5f37-473a-bebf-c574b2a02b43 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:53.986046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:53.986799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:53.987076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:53.987350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:53.988063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:53.990069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.013033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1105/2192] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:53 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:54.017392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:54.029399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d53d-8485-4b07-b7bf-50828f4d3f0d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:54.035364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:54.036190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.036558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.037027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.037843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:54.039687 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.055904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1088/2193] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:54.056962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:54.067489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b96d19-e0d4-4ed6-bafa-ba62b93e9742 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:54.076499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:54.077756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.078190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.078647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] PATH_INFO: `/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d/users/ea406ed4c40f4438b6d36b63e8098002/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.109919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8d562b47094eca9d1c1e99c0719d9d, user_id=ea406ed4c40f4438b6d36b63e8098002, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:54.119148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.160230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:54.161464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1106/2194] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:54 2022] PUT /identity/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d/users/ea406ed4c40f4438b6d36b63e8098002/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:54.188586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241559b-f966-43ac-b79e-f1286503937f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:54.305484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:54.307677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.308335 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.308869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.310799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:54.314966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fcf56-48b9-4cb0-9962-9b6b4cb1a1bd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.344888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:54.356812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1089/2195] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:54.361545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303b5a3-1b97-40f4-a7a8-ef6ed5286f79 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:54.369800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:54.371086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.371931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.372456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] PATH_INFO: `/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d/users/ea406ed4c40f4438b6d36b63e8098002/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.375289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8d562b47094eca9d1c1e99c0719d9d, user_id=ea406ed4c40f4438b6d36b63e8098002, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:54.381269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.408653 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1107/2196] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:54 2022] PUT /identity/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d/users/ea406ed4c40f4438b6d36b63e8098002/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:54.410616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.414797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.415278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.451123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] MFA Rules not processed for user `ea406ed4c40f4438b6d36b63e8098002`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:54.452484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:54.544994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1090/2197] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:54.552730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:54.554684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:54.660444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bcbac-401e-4125-9189-3f9260497350 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:54.666965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:54.668089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:54.670070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:54.670601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:54.690911 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:54.692667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8732f-60c6-4616-baa2-6bd2e961c194 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:54.705105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1108/2198] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:23:56.478333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:56.552936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fca52-45e4-4ca9-81ad-3cea2375e0ea None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:56.561483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:56.562631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:56.562923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:56.563204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] PATH_INFO: `/v3/users/80530ee512b246e4aac3bb9052291bb4` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:56.564885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80530ee512b246e4aac3bb9052291bb4)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:56.568399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:56.657365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80530ee512b246e4aac3bb9052291bb4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:56.658139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80530ee512b246e4aac3bb9052291bb4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:56.673252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80530ee512b246e4aac3bb9052291bb4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:56.681183 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80530ee512b246e4aac3bb9052291bb4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:56.682478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80530ee512b246e4aac3bb9052291bb4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:56.703624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1091/2199] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:56 2022] DELETE /identity/v3/users/80530ee512b246e4aac3bb9052291bb4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:56.711531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:56.713249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:56.714053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:56.768565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:56.771687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:56.879557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1109/2200] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:56.961489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:56.970951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:57.129881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfced93-1aa5-4148-923a-e79955dc30a3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:57.136278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:57.136799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:57.137670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:57.139935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:57.163602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:57.165169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:57.180667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1092/2201] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:23:57.925141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:57.927247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:57.942921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7129edd-32f9-411b-a339-1e9c56998150 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:57.949088 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:57.950180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:57.950652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:57.950849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] PATH_INFO: `/v3/projects/1f56c4b38c3644bd98b97ce88febffc5` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:57.952635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f56c4b38c3644bd98b97ce88febffc5)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:57.954870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:58.033296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f56c4b38c3644bd98b97ce88febffc5', 'request_id': 'req-501efcdc-6401-449e-bc1b-821aee9af606'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.047002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f56c4b38c3644bd98b97ce88febffc5', 'request_id': 'req-501efcdc-6401-449e-bc1b-821aee9af606'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.061478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f56c4b38c3644bd98b97ce88febffc5', 'request_id': 'req-501efcdc-6401-449e-bc1b-821aee9af606'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.081392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] The token cache is being invalidate because project 1f56c4b38c3644bd98b97ce88febffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:58.081842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.082779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.084394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1110/2202] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:57 2022] DELETE /identity/v3/projects/1f56c4b38c3644bd98b97ce88febffc5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:58.089449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:58.102944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1655f33-e7dc-4d03-80b2-782b07116a06 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:58.205162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:58.206667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:58.207116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:58.207532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] PATH_INFO: `/v3/users/ea406ed4c40f4438b6d36b63e8098002` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:58.209592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea406ed4c40f4438b6d36b63e8098002)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:58.212130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:58.296138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea406ed4c40f4438b6d36b63e8098002'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.298304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea406ed4c40f4438b6d36b63e8098002'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.325950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea406ed4c40f4438b6d36b63e8098002'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.339793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea406ed4c40f4438b6d36b63e8098002'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.342234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea406ed4c40f4438b6d36b63e8098002'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:58.358912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1093/2203] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:58 2022] DELETE /identity/v3/users/ea406ed4c40f4438b6d36b63e8098002 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:59.103716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.105213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.117484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.119149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.149347 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501efcdc-6401-449e-bc1b-821aee9af606 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.235517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.236717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.237175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.237385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] PATH_INFO: `/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.238666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8d562b47094eca9d1c1e99c0719d9d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.241591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.282462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9afa8-5078-4842-a777-45a6f78ce9ae admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.305524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8d562b47094eca9d1c1e99c0719d9d', 'request_id': 'req-dd5c491d-57c6-4872-a794-c39f41c117be'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.313938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8d562b47094eca9d1c1e99c0719d9d', 'request_id': 'req-dd5c491d-57c6-4872-a794-c39f41c117be'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.330345 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8d562b47094eca9d1c1e99c0719d9d', 'request_id': 'req-dd5c491d-57c6-4872-a794-c39f41c117be'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.353744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] The token cache is being invalidate because project 4b8d562b47094eca9d1c1e99c0719d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:59.354115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.354746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dd5c491d-57c6-4872-a794-c39f41c117be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.358565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1111/2204] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:59 2022] DELETE /identity/v3/projects/4b8d562b47094eca9d1c1e99c0719d9d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:59.368922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babed71-5a92-4e60-a557-cee6e2b7e276 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.369285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babed71-5a92-4e60-a557-cee6e2b7e276 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.369829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babed71-5a92-4e60-a557-cee6e2b7e276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.378595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.380518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.382178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.382908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] PATH_INFO: `/v3/users/0ec544bab4b94d5e95eaf793afc0138c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.388458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec544bab4b94d5e95eaf793afc0138c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.391777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.395332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7babed71-5a92-4e60-a557-cee6e2b7e276 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:59.396542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7babed71-5a92-4e60-a557-cee6e2b7e276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.415452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1112/2205] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:59.417034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.417329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.417607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.439386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:59.440687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.450655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1113/2206] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:59.454830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.470941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3467304-0d7d-4451-80aa-4cd2a0a6f046 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.476550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.477552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.477987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.478443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.479360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:23:59.479487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec544bab4b94d5e95eaf793afc0138c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.479926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.480094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec544bab4b94d5e95eaf793afc0138c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.482873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.497808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec544bab4b94d5e95eaf793afc0138c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.498747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1114/2207] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:23:59.503137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.504853 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.506134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec544bab4b94d5e95eaf793afc0138c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.506916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec544bab4b94d5e95eaf793afc0138c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.520202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498da0d-7965-4b30-85d8-f1e3c1d6e91c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.532108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1094/2208] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:23:59 2022] DELETE /identity/v3/users/0ec544bab4b94d5e95eaf793afc0138c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:23:59.532406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.532406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.532406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.532406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.532854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.532854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.566637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1115/2209] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:23:59.567908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.634319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d053e1-64af-4067-b439-c0308a909c4e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.702736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.703551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.703782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.704146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.704873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.707064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.716739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.718815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.753196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1095/2210] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:23:59.755054 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6146-a9e5-4caa-9981-90688ff66d50 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.760189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.770448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.771834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.772511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.773055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] PATH_INFO: `/v3/projects/f8bc531651b748a791dbbbc11ee10adb` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.775857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8bc531651b748a791dbbbc11ee10adb)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.780391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.781381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee9e3b-1542-466b-9363-1e7b19976b80 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.791145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.792359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.792846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.793404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.795364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.798508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.813546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1096/2211] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:23:59.820213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.845820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76bb56-05c4-4aca-9b18-9f7b528748e1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.854926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8bc531651b748a791dbbbc11ee10adb', 'request_id': 'req-05837c22-0a5d-4a5e-aa42-036a7b1bb052'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.862729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8bc531651b748a791dbbbc11ee10adb', 'request_id': 'req-05837c22-0a5d-4a5e-aa42-036a7b1bb052'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.872779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8bc531651b748a791dbbbc11ee10adb', 'request_id': 'req-05837c22-0a5d-4a5e-aa42-036a7b1bb052'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.895149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] The token cache is being invalidate because project f8bc531651b748a791dbbbc11ee10adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:23:59.895745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.897040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-05837c22-0a5d-4a5e-aa42-036a7b1bb052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:23:59.900760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1116/2212] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:23:59 2022] DELETE /identity/v3/projects/f8bc531651b748a791dbbbc11ee10adb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:23:59.909895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae63b-8b30-4517-8bea-4fcbef874937 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.910261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae63b-8b30-4517-8bea-4fcbef874937 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.910473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ae63b-8b30-4517-8bea-4fcbef874937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.930921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-868ae63b-8b30-4517-8bea-4fcbef874937 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:59.932181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-868ae63b-8b30-4517-8bea-4fcbef874937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.939533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:23:59.940812 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.941350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.941846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.942650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1117/2213] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:23:59.943445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:23:59.946661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:23:59.951499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:23:59.951805 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:23:59.952052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:23:59.967361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1097/2214] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:23:59.971804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:23:59.973726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.979779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:23:59.981730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:23:59.988620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef820c-775a-45bb-b308-85c13cd2a2fe admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:23:59.995976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1118/2215] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:23:59.997681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.001863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.003478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.003645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.004099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] PATH_INFO: `/v3/projects/2c18e48b339247c49011d494cd29e836/users/c7eeaa400bcc41ea962d25e1b66db87d/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.008438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044c5f0-8740-4ec7-98c0-1a6d9d566a32 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.016053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.017225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.017732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.018222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.019657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:00.020258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.023835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca5a7-d3ee-41c9-bef8-b760d6556a95 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.025150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c18e48b339247c49011d494cd29e836, user_id=c7eeaa400bcc41ea962d25e1b66db87d, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.029014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.049144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1098/2216] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:23:59 2022] PUT /identity/v3/projects/2c18e48b339247c49011d494cd29e836/users/c7eeaa400bcc41ea962d25e1b66db87d/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:00.051374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1119/2217] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:00.059606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.061613 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.061942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.062332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.109165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] MFA Rules not processed for user `c7eeaa400bcc41ea962d25e1b66db87d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:00.110543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:00.169481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247871b9-a14d-4c85-a099-3637320bda62 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.180467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.182373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.183260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.184708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.187008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.194562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.235764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1120/2218] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:00.241824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.254018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1099/2219] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:00.258080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0f3ea-f33c-47ee-86ab-0ff3e1d04b56 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.258606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.344354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d2ec6d-114a-4e77-8377-bc4f349b21ba admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.353022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.354710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.356386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.356526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.357761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.361652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.363190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.364189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.364641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.364992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.365675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.367649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.405157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1100/2220] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:00.405308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1121/2221] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:00.405405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.409737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.416115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30788a01-0d7e-4d1c-be23-003ca7a440b2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.490376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.495033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.495033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.495033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.495033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.495033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.507549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48928508-a0bf-4e45-ba18-7c3e8f3e7d60 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.513923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.514655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.514936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.515249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.516020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.518466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.525775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1101/2222] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:00.530561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.539142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1122/2223] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:00.543376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.546344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a9d6-415e-4ceb-b279-12d96a874ee8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.557232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.558581 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.558957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.559343 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.560252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.561988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.562388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080c16-6909-41af-88ab-c6449a77ad6e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.568340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.570033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.570493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.570924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.571881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.575192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.580862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1102/2224] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:00.581808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.590652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1123/2225] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:00.593038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.608334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee5335-dba5-4af8-b80d-d630dea3bc29 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.612713 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c85a1-50f0-4f12-a614-006ccbfb9e51 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.614228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.615256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.615627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.615977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] PATH_INFO: `/v3/projects/13b3af9878ce4431874f6b72c1b06678/users/28dea6b72cd04134a19794cc7567d71d/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.620348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.621358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.621639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.621912 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] PATH_INFO: `/v3/projects/b4cc8bcef7c54cfb942294d4c27100b0/users/d723c38cd4fc44c7a5cad9e4984612c6/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.636083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b3af9878ce4431874f6b72c1b06678, user_id=28dea6b72cd04134a19794cc7567d71d, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.641413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1f331-0641-4e9e-bc48-28f868c1d75b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.644817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cc8bcef7c54cfb942294d4c27100b0, user_id=d723c38cd4fc44c7a5cad9e4984612c6, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.648688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.666001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1124/2227] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:00 2022] PUT /identity/v3/projects/b4cc8bcef7c54cfb942294d4c27100b0/users/d723c38cd4fc44c7a5cad9e4984612c6/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:00.666318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1103/2227] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:00 2022] PUT /identity/v3/projects/13b3af9878ce4431874f6b72c1b06678/users/28dea6b72cd04134a19794cc7567d71d/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:00.670174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.680436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.681143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.681777 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.729951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] MFA Rules not processed for user `d723c38cd4fc44c7a5cad9e4984612c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:00.732411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:00.760141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a3e7b-254d-495d-8f2d-dc8a504bf237 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.766696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.767397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.767686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.767971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.768732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.770416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.793989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1125/2228] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:00.793989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.814646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b9ab7-7f8a-4ba1-9af3-75b93780387c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.820147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.821421 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.821774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.822162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] PATH_INFO: `/v3/projects/13b3af9878ce4431874f6b72c1b06678/users/28dea6b72cd04134a19794cc7567d71d/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.825168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b3af9878ce4431874f6b72c1b06678, user_id=28dea6b72cd04134a19794cc7567d71d, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.828995 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b5798-5b81-4e81-acd3-cd9ffa43849b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.843662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1126/2229] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:00 2022] PUT /identity/v3/projects/13b3af9878ce4431874f6b72c1b06678/users/28dea6b72cd04134a19794cc7567d71d/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:00.861558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.861852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.862140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.878719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1104/2230] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:00.879644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:00.898737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] MFA Rules not processed for user `28dea6b72cd04134a19794cc7567d71d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:00.900081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:00.907319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa71a7-27ce-4cf2-8ac6-8982b87b7fba None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:00.985824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1127/2231] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:00.987859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:00.988533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:00.988820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:00.989452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:00.990203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:00.992382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:00.999075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.000497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:01.026531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1105/2232] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:00 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:01.031182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.066788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a036b-64fd-4dca-a329-f592f1d594d9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.106729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9a658-18e2-41c3-b8c4-a98680cad6b1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.112582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.112790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.113110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.113395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.114192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.116089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.125130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.125795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.126079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.126355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.150714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1106/2233] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:01 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:01.152084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.165145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977754ef-f1af-49dd-ac7b-d4dab97a1c0c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.174701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.176091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.176566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.176857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.177706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.179318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.195500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1107/2234] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:01.199825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.210682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.212299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.218355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1262-89db-44d7-acdc-18c22f5b9958 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.223533 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1128/2235] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:01.228414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.229472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.229831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.230383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] PATH_INFO: `/v3/projects/12f84ea987394edf9c2d9ad74caf9b80/users/b43d94a6683b440fafdbe64822edb5ef/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.251561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f84ea987394edf9c2d9ad74caf9b80, user_id=b43d94a6683b440fafdbe64822edb5ef, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.254213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.302015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1108/2236] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:01 2022] PUT /identity/v3/projects/12f84ea987394edf9c2d9ad74caf9b80/users/b43d94a6683b440fafdbe64822edb5ef/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:01.306073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.323390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a93b8-72e3-41a5-bc9a-f4e30d213409 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.399865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.400542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.400825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.401151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.401901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.403553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0686a-bb6d-440d-8e7d-c91f95a34a20 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.416404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1129/2237] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:01.421169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.432350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064926e-0a92-443f-aaa5-e9592602307c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.439164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.440233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.440621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.441160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] PATH_INFO: `/v3/projects/12f84ea987394edf9c2d9ad74caf9b80/users/b43d94a6683b440fafdbe64822edb5ef/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.443294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f84ea987394edf9c2d9ad74caf9b80, user_id=b43d94a6683b440fafdbe64822edb5ef, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.446310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.460272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1109/2238] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:01 2022] PUT /identity/v3/projects/12f84ea987394edf9c2d9ad74caf9b80/users/b43d94a6683b440fafdbe64822edb5ef/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:01.472938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.472938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.472938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.505406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] MFA Rules not processed for user `b43d94a6683b440fafdbe64822edb5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:01.506538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:01.595036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1130/2239] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:01.606774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.608847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:01.623519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.682207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c106e03-6322-4488-ac99-c185cca08f0a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.689441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.689860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.690176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.690426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.696979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969b66b-67f2-475f-8a1f-855c4c435160 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.702276 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.703182 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dea6b72cd04134a19794cc7567d71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b3af9878ce4431874f6b72c1b06678', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.703765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.710235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.710235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.710549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.711895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:01.711895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.713282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.719361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1110/2240] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:01.731704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1131/2241] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:01.735689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.759742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90098308-c672-4607-b3fa-6f6f4af35c17 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.776004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dea6b72cd04134a19794cc7567d71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b3af9878ce4431874f6b72c1b06678', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.776701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.777029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.777321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.778726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.780524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.825630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1111/2242] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:01 2022] POST /identity/v3/projects => generated 353 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:01.825893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.846196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c87dd9-8b83-4203-8326-1cadeae97dcf tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:01.884518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:01.965573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dea6b72cd04134a19794cc7567d71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b3af9878ce4431874f6b72c1b06678', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:01.966457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:01.966812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:01.967226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:01.968473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:01.968951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:01.971072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:01.995224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1132/2243] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:24:01.995822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403311b4-18c2-481b-b278-c2a7792565ae tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:02.004192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:02.005143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.005432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.005708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] PATH_INFO: `/v3/users/d723c38cd4fc44c7a5cad9e4984612c6` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.007367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d723c38cd4fc44c7a5cad9e4984612c6)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:02.009540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:02.036926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:02.049022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ffd20-25d2-4be9-846c-5ac4c04154db tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:02.055923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28dea6b72cd04134a19794cc7567d71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13b3af9878ce4431874f6b72c1b06678', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:02.056929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.057234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.057540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] PATH_INFO: `/v3/projects/e39b958a265c43f18c4a4e730666f8db` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.058908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e39b958a265c43f18c4a4e730666f8db)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:02.060887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:02.085069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd723c38cd4fc44c7a5cad9e4984612c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.086147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd723c38cd4fc44c7a5cad9e4984612c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.103575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd723c38cd4fc44c7a5cad9e4984612c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.113590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd723c38cd4fc44c7a5cad9e4984612c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.115985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-17b18b09-a0ce-4d90-8ab2-d66c9d985ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd723c38cd4fc44c7a5cad9e4984612c6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.133033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39b958a265c43f18c4a4e730666f8db', 'request_id': 'req-881236f8-6501-4aeb-b0e8-275755b48c37'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.134169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1112/2244] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:01 2022] DELETE /identity/v3/users/d723c38cd4fc44c7a5cad9e4984612c6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:02.139773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.140058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.140507 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.141213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39b958a265c43f18c4a4e730666f8db', 'request_id': 'req-881236f8-6501-4aeb-b0e8-275755b48c37'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.155625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39b958a265c43f18c4a4e730666f8db', 'request_id': 'req-881236f8-6501-4aeb-b0e8-275755b48c37'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.175384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:02.178589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:02.188356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] The token cache is being invalidate because project e39b958a265c43f18c4a4e730666f8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:02.189236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.191340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.194989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1133/2245] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:02 2022] DELETE /identity/v3/projects/e39b958a265c43f18c4a4e730666f8db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:02.280674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1113/2246] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:02.296785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:02.301293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:02.394814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881236f8-6501-4aeb-b0e8-275755b48c37 tempest-VolumeQuotaClassesTest-1220737421 tempest-VolumeQuotaClassesTest-1220737421-project-admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:02.469550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:02.472801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:02.498055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:02.498857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.499239 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.499702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.507007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bf9bf-b2fc-4231-a7da-2450cf8f6d0d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:02.514949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:02.516679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.517440 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.517957 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] PATH_INFO: `/v3/users/c7eeaa400bcc41ea962d25e1b66db87d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.524566 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eeaa400bcc41ea962d25e1b66db87d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:02.526053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:02.528497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:02.532568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b143c7-5cbe-4eeb-93df-64237fa9deb9 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:02.561831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1134/2247] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:02.640516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eeaa400bcc41ea962d25e1b66db87d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.641990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eeaa400bcc41ea962d25e1b66db87d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.667256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eeaa400bcc41ea962d25e1b66db87d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.679651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eeaa400bcc41ea962d25e1b66db87d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.682153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eeaa400bcc41ea962d25e1b66db87d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:02.700994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1114/2248] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:02 2022] DELETE /identity/v3/users/c7eeaa400bcc41ea962d25e1b66db87d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:02.706265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.706265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.706593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:02.732236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:02.734179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:02.911842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1135/2249] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:02.923406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:02.926040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:02.991262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf34ff-4634-49ed-ae08-46d24cbdc35b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:02.996141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:02.997643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:02.998017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:02.998301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:03.003306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:03.004807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:03.009854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:03.011328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:03.020862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5f55c-ce74-4403-9700-e1ce5115252b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:03.022463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1115/2250] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:03.027873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:03.028799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:03.029692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:03.030349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] PATH_INFO: `/v3/projects/b4cc8bcef7c54cfb942294d4c27100b0` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:03.031404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cc8bcef7c54cfb942294d4c27100b0)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:03.038296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:03.119882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cc8bcef7c54cfb942294d4c27100b0', 'request_id': 'req-73a1b323-0909-4574-8f8d-0add049b208d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.128886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cc8bcef7c54cfb942294d4c27100b0', 'request_id': 'req-73a1b323-0909-4574-8f8d-0add049b208d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.138572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cc8bcef7c54cfb942294d4c27100b0', 'request_id': 'req-73a1b323-0909-4574-8f8d-0add049b208d'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.161700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] The token cache is being invalidate because project b4cc8bcef7c54cfb942294d4c27100b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:03.162298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.163189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.165320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1136/2251] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:03 2022] DELETE /identity/v3/projects/b4cc8bcef7c54cfb942294d4c27100b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:03.171412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:03.187346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafed3d-3cda-4a69-8df2-ce32710193f4 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:03.313732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:03.314853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:03.315238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:03.315639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] PATH_INFO: `/v3/users/b43d94a6683b440fafdbe64822edb5ef` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:03.316995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43d94a6683b440fafdbe64822edb5ef)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:03.319167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:03.408145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43d94a6683b440fafdbe64822edb5ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.408972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43d94a6683b440fafdbe64822edb5ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.424575 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:03.427948 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:03.439981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43d94a6683b440fafdbe64822edb5ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.443009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1b323-0909-4574-8f8d-0add049b208d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:03.452375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:03.453324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:03.453607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:03.453885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] PATH_INFO: `/v3/projects/2c18e48b339247c49011d494cd29e836` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:03.455155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c18e48b339247c49011d494cd29e836)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:03.457427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:03.471168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43d94a6683b440fafdbe64822edb5ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.473796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43d94a6683b440fafdbe64822edb5ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.494855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1116/2252] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:03 2022] DELETE /identity/v3/users/b43d94a6683b440fafdbe64822edb5ef => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:03.532338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c18e48b339247c49011d494cd29e836', 'request_id': 'req-6c274e1c-aa9a-4227-b74d-03889b6fc33a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.541408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c18e48b339247c49011d494cd29e836', 'request_id': 'req-6c274e1c-aa9a-4227-b74d-03889b6fc33a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.553987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c18e48b339247c49011d494cd29e836', 'request_id': 'req-6c274e1c-aa9a-4227-b74d-03889b6fc33a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.578924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] The token cache is being invalidate because project 2c18e48b339247c49011d494cd29e836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:03.579355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.580329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.585514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1137/2253] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:03 2022] DELETE /identity/v3/projects/2c18e48b339247c49011d494cd29e836 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:03.588499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:03.590962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:03.689531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae22c1-b253-402e-8e24-7c9e2d1bd703 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:03.807948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:03.813265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:03.813945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:03.814238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] PATH_INFO: `/v3/users/28dea6b72cd04134a19794cc7567d71d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:03.816254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=28dea6b72cd04134a19794cc7567d71d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:03.818814 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:03.890084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28dea6b72cd04134a19794cc7567d71d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.893740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28dea6b72cd04134a19794cc7567d71d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.945883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28dea6b72cd04134a19794cc7567d71d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.961271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:03.963455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:03.981168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28dea6b72cd04134a19794cc7567d71d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:03.987089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ec2e1273-944c-4ad0-951c-b7aecd6370fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28dea6b72cd04134a19794cc7567d71d'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.031759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1117/2254] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:03 2022] DELETE /identity/v3/users/28dea6b72cd04134a19794cc7567d71d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:04.037526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c274e1c-aa9a-4227-b74d-03889b6fc33a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.188928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.188928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.188928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.188928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] PATH_INFO: `/v3/projects/12f84ea987394edf9c2d9ad74caf9b80` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.190817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f84ea987394edf9c2d9ad74caf9b80)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.194324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.280705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f84ea987394edf9c2d9ad74caf9b80', 'request_id': 'req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.288102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f84ea987394edf9c2d9ad74caf9b80', 'request_id': 'req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.301156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f84ea987394edf9c2d9ad74caf9b80', 'request_id': 'req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.325524 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] The token cache is being invalidate because project 12f84ea987394edf9c2d9ad74caf9b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:04.326061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.327313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9f4c506-5cea-4924-88ad-75dd5b9d58d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.336509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1138/2255] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:03 2022] DELETE /identity/v3/projects/12f84ea987394edf9c2d9ad74caf9b80 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:04.339929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.344536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.347006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.389598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:04.390916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.501074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1118/2256] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:04.508005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.508293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.508663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.535046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:04.536684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.543900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.545615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.552819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1139/2257] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:04.558056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.562671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f881e19-3174-4b8f-afe4-d03f27192871 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.568638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.569669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.570067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.570409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] PATH_INFO: `/v3/projects/13b3af9878ce4431874f6b72c1b06678` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.571270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791d521-9623-4ae3-9599-db4d7fc8765d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.571831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b3af9878ce4431874f6b72c1b06678)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.574672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.580619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.581500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.581782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.582055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.583146 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:04.583593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.585916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.607693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1140/2258] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:04.614590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.642066 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a298dd-3e5e-4056-b215-ae518191457e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.661758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b3af9878ce4431874f6b72c1b06678', 'request_id': 'req-fa122f02-bcf1-43dd-b2db-e612dc3cb185'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.675060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b3af9878ce4431874f6b72c1b06678', 'request_id': 'req-fa122f02-bcf1-43dd-b2db-e612dc3cb185'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.710302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b3af9878ce4431874f6b72c1b06678', 'request_id': 'req-fa122f02-bcf1-43dd-b2db-e612dc3cb185'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.738457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] The token cache is being invalidate because project 13b3af9878ce4431874f6b72c1b06678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:04.739056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.739934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fa122f02-bcf1-43dd-b2db-e612dc3cb185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:04.745500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1119/2259] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:04 2022] DELETE /identity/v3/projects/13b3af9878ce4431874f6b72c1b06678 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:04.750243 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8e6b-970a-4f6c-bc09-a9c7a22861d5 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.751376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8e6b-970a-4f6c-bc09-a9c7a22861d5 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.752186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f8e6b-970a-4f6c-bc09-a9c7a22861d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.766751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.767082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.767370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.767781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.768579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.770875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.777072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e02f8e6b-970a-4f6c-bc09-a9c7a22861d5 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:04.779488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e02f8e6b-970a-4f6c-bc09-a9c7a22861d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.794428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1120/2260] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:04.807147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.807547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.807800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1141/2261] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:04.807973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.813704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.815671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.842608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:04.844525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:04.893927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f88c-3a20-41ec-ad99-e35182b74111 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.900303 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.900955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.901244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.901528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.902240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.904977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.925058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1121/2262] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:04.930970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.931565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1142/2263] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:04.936590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.947082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e8c7-de1d-44b6-94a1-f0e09189c49c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.951925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fea8b-6480-49c2-894a-e4f8b9ccbdd2 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.953068 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.953784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.954067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.954376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.955269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.957349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.961496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.962578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.963000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.963657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.964608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:04.965288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.967092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.973055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1143/2264] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:04.974119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.979476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1122/2265] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:04.984949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:04.985448 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97aa21-b74b-47b0-8178-0e18888873ca admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:04.990107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:04.990767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:04.991050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:04.991322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:04.992058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:04.993770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:04.995632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906957-49c3-4538-aef4-6afdbdd2c88f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.001597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.002200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.002484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.002761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.003460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.005125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1144/2266] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:05.005386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.009164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.020673 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35874f8-b8f2-4133-b0e3-2f176c74e742 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.026214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.027250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.028067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.028647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] PATH_INFO: `/v3/projects/48c666b57f2848bdbd0f7c83abe07d83/users/f7b396b9bec446fab0576047c0782001/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.045411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1123/2267] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:04 2022] POST /identity/v3/projects => generated 409 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:05.046514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.047509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c666b57f2848bdbd0f7c83abe07d83, user_id=f7b396b9bec446fab0576047c0782001, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.050877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40bcd9-b48d-400f-a9a8-28316ebb5a86 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.068389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1145/2268] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:05 2022] PUT /identity/v3/projects/48c666b57f2848bdbd0f7c83abe07d83/users/f7b396b9bec446fab0576047c0782001/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:05.082518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.082804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.083061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.116798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] MFA Rules not processed for user `f7b396b9bec446fab0576047c0782001`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:05.118373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:05.130193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c63653-bed8-4e10-af05-81b9051fa9a2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.199058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1146/2269] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:05.203704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.208872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.209610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.209893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.210168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.210898 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.212791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.236110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1124/2270] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/users => generated 305 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:05.240280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.251069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a041f5-1a60-48d6-b61b-a2c8b085b1fe admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.256235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.257007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.257294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.258293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.259130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.260832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.271361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1125/2271] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:05.272440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cca10-9bb4-4622-9d6a-2419a4e8989a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.275483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.277892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.278538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.278817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.279091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.279790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.281756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.287828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48e203-d387-4487-81d3-8d5063bca5ab admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.299709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.300474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.300782 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.301113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.302107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.303947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.313436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1147/2272] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:05.318017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1126/2273] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:05.318223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.319224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.329483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10dc25-6f75-4b02-9f8c-7396467d2be0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.388682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7e7a1-7745-4a8d-a3a6-f0837673fd62 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.390369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.391293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.391641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.391914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] PATH_INFO: `/v3/projects/6882d761f76d424aa61c4e4a16ef07bd/users/30d3526c13b14a478d280bf0dce380b6/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.393755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.394570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.395722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.395722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.396055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.398067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.410238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6882d761f76d424aa61c4e4a16ef07bd, user_id=30d3526c13b14a478d280bf0dce380b6, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.413171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd57199-c7ff-496d-b4d7-6a7495dc60b0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.421320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1148/2274] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:05.425717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.429596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1127/2275] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:05 2022] PUT /identity/v3/projects/6882d761f76d424aa61c4e4a16ef07bd/users/30d3526c13b14a478d280bf0dce380b6/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:05.444601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653290d-848b-453f-a118-acc7a5f5b09f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.445485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.445796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.446156 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.475565 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] MFA Rules not processed for user `30d3526c13b14a478d280bf0dce380b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:05.476971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:05.506682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.507480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.507775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.508154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.509038 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.513946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.522489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1149/2276] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:05.529208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.540866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e3d66-1f0c-4da9-a4cd-f11bea080bdd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.547043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.547714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.547996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.548275 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.549112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.550709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.560194 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1128/2277] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:05.561655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1150/2278] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:05.565363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.565619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.578681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ba540-577a-4151-9a31-c5776d22cafa None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.584693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.585285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d79fc-1a95-4d95-bc5c-5f3f65da6f3c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.585644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.585929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.586257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] PATH_INFO: `/v3/projects/a92a88e0a5e8485c85ad2bbd417a884e/users/3b7f2d721d2846b4815c85e11e29cb39/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.592982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.593664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.593950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.594231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.594984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.596968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c1eb8-d941-49e5-b466-5df3f481c1c4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.603818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92a88e0a5e8485c85ad2bbd417a884e, user_id=3b7f2d721d2846b4815c85e11e29cb39, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.607111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.622803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1129/2279] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:05 2022] PUT /identity/v3/projects/a92a88e0a5e8485c85ad2bbd417a884e/users/3b7f2d721d2846b4815c85e11e29cb39/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:05.634939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1151/2280] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/projects => generated 409 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:05.635141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.641864 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.642085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.642360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.672325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] MFA Rules not processed for user `3b7f2d721d2846b4815c85e11e29cb39`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:05.673164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:05.702119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99514b4-93a9-42fe-8547-8b9f5739e05b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.758416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1152/2281] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:05.763661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.808181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.810009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.810173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.810460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.811186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.813181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.852959 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1130/2282] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:05.857831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.869740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035946ce-59c6-4f8c-9045-5a4e3fac79be admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.876671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.877706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.878192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.878720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.879684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.881844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.882586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017a455-08f0-49e7-89a2-896de1b13feb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.890282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.891423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.891818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.892169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.893343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.896206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.900026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1131/2283] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:05.904443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.914901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606346d8-1864-4b6e-bfda-11f4d7fefbbe admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:05.921890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:05.923431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:05.923720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:05.924122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] PATH_INFO: `/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab/users/94c5ebdc8a254b3d885e10550082100f/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:05.932796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1153/2284] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:05.937440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:05.947030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bfd656aa2841fcbe49339eb057c0ab, user_id=94c5ebdc8a254b3d885e10550082100f, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:05.952427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:05.976444 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1132/2285] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:05 2022] PUT /identity/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab/users/94c5ebdc8a254b3d885e10550082100f/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:05.981903 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.023064 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14d2c2-dd97-44c5-970e-dada19b2cb82 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.073097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c324ee-4421-4250-97ba-8377bdc02f75 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.082650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.084422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.084962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.085468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.086912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.091401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.110811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1133/2286] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:06.112965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.115746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.116840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.117582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.118090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.119709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.125089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad965da-10c0-4bd0-8b5a-6bba1604b2cf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.127798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b729f-9009-495d-844f-c0c3af4e69af admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.133083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.133990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.134279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.134560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] PATH_INFO: `/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab/users/94c5ebdc8a254b3d885e10550082100f/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.136679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bfd656aa2841fcbe49339eb057c0ab, user_id=94c5ebdc8a254b3d885e10550082100f, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.139463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.152135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1134/2287] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:06 2022] PUT /identity/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab/users/94c5ebdc8a254b3d885e10550082100f/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:06.156969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1154/2288] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:05 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:06.162397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.163766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.164063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.164445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.195822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] MFA Rules not processed for user `94c5ebdc8a254b3d885e10550082100f`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:06.197511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:06.268196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753c7ca-ddad-4be3-a0b0-bb8e95ea698a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.273149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.273830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.274116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.274548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.275312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.280930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.289537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1155/2289] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:06.298026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1135/2290] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:06.305865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.306912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.310983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:06.326115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8769-8347-42f0-a249-f5ecb32dd32a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.334403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.336006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.336647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.337285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] PATH_INFO: `/v3/projects/385324af862049e9a18cd0c197a587df/users/36c2501fdf5c4e7c971087586ccb34d7/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.368060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385324af862049e9a18cd0c197a587df, user_id=36c2501fdf5c4e7c971087586ccb34d7, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.375085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.400257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1156/2291] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:06 2022] PUT /identity/v3/projects/385324af862049e9a18cd0c197a587df/users/36c2501fdf5c4e7c971087586ccb34d7/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:06.406225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4df29-5454-444b-a0f3-5d877c1228fb admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.407055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.486946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.488341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.489001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.489364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.512919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3387ca-c427-4e7a-a964-4cec99ffd8b7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.519215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.520035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.520401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.520684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.521497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.523179 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.536348 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1157/2292] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:06.539509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.552520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134916a-482c-4695-a264-7171d4549fdd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.559516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.560432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.560737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.561121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] PATH_INFO: `/v3/projects/385324af862049e9a18cd0c197a587df/users/36c2501fdf5c4e7c971087586ccb34d7/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.563298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385324af862049e9a18cd0c197a587df, user_id=36c2501fdf5c4e7c971087586ccb34d7, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.566887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f3a09-8c75-437b-ac45-af7a6d199954 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.569246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.571385 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.580198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1158/2293] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:06 2022] PUT /identity/v3/projects/385324af862049e9a18cd0c197a587df/users/36c2501fdf5c4e7c971087586ccb34d7/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:06.587080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1136/2294] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:06 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:06.591061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0071-9303-4b89-9851-b572892bea48 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.591383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0071-9303-4b89-9851-b572892bea48 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.591672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0071-9303-4b89-9851-b572892bea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.625405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-767b0071-9303-4b89-9851-b572892bea48 None None] MFA Rules not processed for user `36c2501fdf5c4e7c971087586ccb34d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:06.626655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-767b0071-9303-4b89-9851-b572892bea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:06.739424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1159/2295] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:06.751931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.766102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace7b36-0973-49a2-83de-f49f8b74a4d8 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.784526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b0071-9303-4b89-9851-b572892bea48 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:06.786364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-767b0071-9303-4b89-9851-b572892bea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:06.828052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.828766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.829112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.829398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.839258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.841073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:06.850557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b0071-9303-4b89-9851-b572892bea48 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:06.852810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1137/2296] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:06.854479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:06.855125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:06.855445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:06.856520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:06.997522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:06.999369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60637fdd-cf71-450d-a208-2a110478ba7a service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:07.013633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1160/2297] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:07.573819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:07.583993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5444a1-c255-401e-a6ba-e14305c3cf18 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:07.588190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:07.588868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:07.589180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:07.589461 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:07.675350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:07.677003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:07.687982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1138/2298] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:17.051009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:17.051546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:17.051546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:17.069293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:17.070478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:17.127758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1161/2299] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:17.151104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:17.152492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:17.232447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a728-291c-42ca-b32c-7cae92af4a05 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:17.241692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:17.242533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:17.242819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:17.243174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:17.253248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:17.254894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:17.264414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1139/2300] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:24:19.332937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:19.334383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:19.441949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:19.447748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1f5ab-2304-430f-a553-f5fe40eb9d49 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:19.452871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:19.453773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:19.454063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:19.454342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:19.454610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eb286-bef3-47fb-9fc3-55e96f64014d service swift] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:19.459989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:19.461255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:19.461970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:19.462476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:19.462962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:19.543114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:19.546091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:19.567034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:19.568406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834b84d-1f2f-402f-8112-ebabbe042ea7 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:19.576220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1140/2301] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:19.594504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1162/2302] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:20.068863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:20.193187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b4d80-a83c-42e1-af75-10f9e44630d9 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:20.203472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:20.205835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:20.209509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:20.209974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] PATH_INFO: `/v3/users/30d3526c13b14a478d280bf0dce380b6` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:20.211965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d3526c13b14a478d280bf0dce380b6)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:20.219026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:20.353458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d3526c13b14a478d280bf0dce380b6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:20.354756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d3526c13b14a478d280bf0dce380b6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:20.387309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d3526c13b14a478d280bf0dce380b6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:20.421836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d3526c13b14a478d280bf0dce380b6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:20.423866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d3526c13b14a478d280bf0dce380b6'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:20.448356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1141/2303] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:20 2022] DELETE /identity/v3/users/30d3526c13b14a478d280bf0dce380b6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:20.453898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:20.454431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:20.454431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:20.486711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:20.488080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:20.674385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1163/2304] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:20.692634 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:20.694158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:20.810069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afc75c-59fb-43ca-a011-0e038e221066 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:20.818499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:20.819785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:20.820305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:20.821005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:20.852751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:20.855621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:20.875117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1142/2305] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:21.428244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:21.429727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:21.455902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4c5a4-53c2-412b-90ae-04472e7bce15 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:21.471905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:21.474579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:21.476391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:21.477085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] PATH_INFO: `/v3/projects/6882d761f76d424aa61c4e4a16ef07bd` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:21.484309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6882d761f76d424aa61c4e4a16ef07bd)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:21.492082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:21.621537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6882d761f76d424aa61c4e4a16ef07bd', 'request_id': 'req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:21.630070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6882d761f76d424aa61c4e4a16ef07bd', 'request_id': 'req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:21.643087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6882d761f76d424aa61c4e4a16ef07bd', 'request_id': 'req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:21.657826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] The token cache is being invalidate because project 6882d761f76d424aa61c4e4a16ef07bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:21.658418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:21.659443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:21.661746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1164/2306] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:21 2022] DELETE /identity/v3/projects/6882d761f76d424aa61c4e4a16ef07bd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:21.667219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:21.699087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff0a0-ec9c-4efd-86d7-725c54220caf service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:21.854317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:21.855827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:21.856887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:21.857387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] PATH_INFO: `/v3/users/94c5ebdc8a254b3d885e10550082100f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:21.862494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94c5ebdc8a254b3d885e10550082100f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:21.866373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:22.049514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94c5ebdc8a254b3d885e10550082100f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.052249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94c5ebdc8a254b3d885e10550082100f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.113885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94c5ebdc8a254b3d885e10550082100f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.149574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94c5ebdc8a254b3d885e10550082100f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.150438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94c5ebdc8a254b3d885e10550082100f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.185667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1143/2307] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:21 2022] DELETE /identity/v3/users/94c5ebdc8a254b3d885e10550082100f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:22.623764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:22.626216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:22.630258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:22.632730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:22.671391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ac8eb-a0cc-46c1-ae52-ccca9f23a99f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:22.849636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:22.851701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:22.852100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:22.852662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] PATH_INFO: `/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:22.855442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bfd656aa2841fcbe49339eb057c0ab)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:22.858828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:22.885026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e910d-70cf-4f03-b4a1-9e6f7cdeffe3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:22.899451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:22.901245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:22.901970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:22.905292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] PATH_INFO: `/v3/users/f7b396b9bec446fab0576047c0782001` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:22.909500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b396b9bec446fab0576047c0782001)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:22.915113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:22.980442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bfd656aa2841fcbe49339eb057c0ab', 'request_id': 'req-85d7855d-1916-4418-8b9f-ce9658f466f6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:22.992814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bfd656aa2841fcbe49339eb057c0ab', 'request_id': 'req-85d7855d-1916-4418-8b9f-ce9658f466f6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.006349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bfd656aa2841fcbe49339eb057c0ab', 'request_id': 'req-85d7855d-1916-4418-8b9f-ce9658f466f6'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.056389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] The token cache is being invalidate because project b6bfd656aa2841fcbe49339eb057c0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:23.057567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.061564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-85d7855d-1916-4418-8b9f-ce9658f466f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.069023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1165/2308] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:22 2022] DELETE /identity/v3/projects/b6bfd656aa2841fcbe49339eb057c0ab => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:23.081318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8b1f-e710-4a6d-8feb-1c8d0ef072c6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.086909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8b1f-e710-4a6d-8feb-1c8d0ef072c6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.087586 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8b1f-e710-4a6d-8feb-1c8d0ef072c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.108872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b396b9bec446fab0576047c0782001'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.118193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b396b9bec446fab0576047c0782001'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.145494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b396b9bec446fab0576047c0782001'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.150062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-260a8b1f-e710-4a6d-8feb-1c8d0ef072c6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:23.151828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-260a8b1f-e710-4a6d-8feb-1c8d0ef072c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:23.192109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b396b9bec446fab0576047c0782001'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.193464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2b898002-bf7a-4025-8d87-7171464800b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b396b9bec446fab0576047c0782001'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:23.250660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1144/2309] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:22 2022] DELETE /identity/v3/users/f7b396b9bec446fab0576047c0782001 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:23.259249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.260016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.261121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.268943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1166/2310] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:23.279638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.280160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.280984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.320938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:23.324289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:23.405929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:23.406219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:23.456385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1167/2311] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:23.464686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:23.489767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81ef2-69b5-4d1e-9de3-913178666cd6 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:23.497236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:23.499443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.500023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.500538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.501582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:23.502122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:23.504009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:23.517789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1168/2312] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:23.522620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:23.533729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1145/2313] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:23.537498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4da3c-8af4-41b5-9396-c225df2a1862 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:23.544208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:23.544919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.545255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.545649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.546929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:23.549388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:23.562186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:23.564318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:23.641817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1169/2314] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:23 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:23.643726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:23.656860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8456380-d992-4a7d-a0f5-6599eecdc755 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:23.739968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:23.741441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.742497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.743075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.838986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:23.842235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:23.855338 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1146/2315] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:23.950325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf9e8-64ab-4f04-8ac1-78eae2a6fb07 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:23.967677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:23.967677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:23.967677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:23.968324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:23.968654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:23.971044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:24.048944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1170/2316] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:23 2022] POST /identity/v3/users => generated 290 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:24.054993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:24.084467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e912-b227-4b29-9881-47d646135568 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:24.105023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:24.109988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:24.110426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:24.110940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:24.112025 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:24.114476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:24.139637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1147/2317] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:24.144387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:24.159504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff45aef-6c69-4e6d-b2a3-dea537f53711 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:24.176169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:24.177725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:24.178292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:24.178789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:24.181031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:24.183538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1243f2f-5e13-4a18-bf58-0d1106b55754 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:24.219979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1171/2318] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:24.224871 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:24.246382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf93dd-28d9-4263-9636-3e9ab22aa745 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:24.262086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:24.263874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:24.264452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:24.264981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] PATH_INFO: `/v3/projects/7834e91498524a179788e0220219795c/users/acafc70c254946a7ba6725179ca42a88/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:24.316446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7834e91498524a179788e0220219795c, user_id=acafc70c254946a7ba6725179ca42a88, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:24.319851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:24.347908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1148/2319] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:24 2022] PUT /identity/v3/projects/7834e91498524a179788e0220219795c/users/acafc70c254946a7ba6725179ca42a88/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:24.360149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:24.360885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:24.361413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:24.427547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] MFA Rules not processed for user `acafc70c254946a7ba6725179ca42a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:24.429419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:24.660969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1172/2320] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:24.666113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:24.854007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba4112-ec9f-481d-bbdd-bb51faefbc83 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:24.879032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:24.879994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:24.881725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:24.883772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:24.885009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:24.895052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:24.965027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1149/2321] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:24 2022] POST /identity/v3/projects => generated 377 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:24.966208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:24.982736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606be6-8d81-4f41-a45e-ed89dda2c385 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:25.108159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:25.108994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.109442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.109724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.110453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:25.112462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:25.159649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1173/2322] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:24 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:25.166241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:25.183128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261307a-e373-4729-9083-ab4ee20f2aba admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:25.198917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:25.200627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.201319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.201842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.203155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:25.209846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:25.235986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1150/2323] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:25.237642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:25.251316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024049-56c5-4c72-9536-4e4c2c74e980 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:25.267235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:25.267891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.268191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.268498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.269497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:25.271202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b03626-1ffa-4653-a42f-a885e2799430 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:25.303974 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1174/2324] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:25.305477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:25.332728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cdce8-233b-4bb4-983a-bde569176799 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:25.348723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:25.350117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.352659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.354489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] PATH_INFO: `/v3/projects/925991f87bd94a3189047fcc100aa8bc/users/641dff7e919b4767a087535a69b59a12/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.403612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925991f87bd94a3189047fcc100aa8bc, user_id=641dff7e919b4767a087535a69b59a12, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:25.407387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:25.473134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1151/2325] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:25 2022] PUT /identity/v3/projects/925991f87bd94a3189047fcc100aa8bc/users/641dff7e919b4767a087535a69b59a12/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:25.479755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.480402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.480944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.541973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] MFA Rules not processed for user `641dff7e919b4767a087535a69b59a12`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:25.547959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:25.698231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1175/2326] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:25.705053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:25.957267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25af60-1ccf-4f2c-9ca2-14d6ba841277 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:25.964159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:25.964849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:25.965174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:25.966094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:25.966912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:25.969219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.018502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1152/2327] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:25 2022] POST /identity/v3/projects => generated 377 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:26.022707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.041262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465f28-81cf-4adb-aecf-7d1949258e5a None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.295567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.299252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:26.305355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.307352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.307672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.307956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.311102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.315183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.348500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd04c-de33-4878-b769-b547a7ef5007 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.364595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.365983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.366361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.366642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] PATH_INFO: `/v3/projects/48c666b57f2848bdbd0f7c83abe07d83` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.370608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c666b57f2848bdbd0f7c83abe07d83)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.373821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.417125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1176/2328] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:26 2022] POST /identity/v3/users => generated 295 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:26.418153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.453181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef7c4b-92d0-41de-b420-4b6beafe60c0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.467857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.468772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.469098 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.469383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.470169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.471859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.493777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1177/2329] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:26.500429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.525570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60693ae-3631-4e0e-aff3-3f10e84d350f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.538287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.539478 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.539852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.540153 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] PATH_INFO: `/v3/projects/4755b1cd34ff4b9ca86018d2cc423764/users/f39422beb8e443ab86880cfc83332162/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.578406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4755b1cd34ff4b9ca86018d2cc423764, user_id=f39422beb8e443ab86880cfc83332162, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.581363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.615031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1178/2330] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:26 2022] PUT /identity/v3/projects/4755b1cd34ff4b9ca86018d2cc423764/users/f39422beb8e443ab86880cfc83332162/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:26.620783 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.674000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c666b57f2848bdbd0f7c83abe07d83', 'request_id': 'req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:26.690398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c666b57f2848bdbd0f7c83abe07d83', 'request_id': 'req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:26.715955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c666b57f2848bdbd0f7c83abe07d83', 'request_id': 'req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:26.769115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ddac0-e929-42d0-9b32-8a2169d712d3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.771262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] The token cache is being invalidate because project 48c666b57f2848bdbd0f7c83abe07d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:26.772029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:26.773357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:26.779827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1153/2331] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:26 2022] DELETE /identity/v3/projects/48c666b57f2848bdbd0f7c83abe07d83 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:26.791005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.794520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:26.876532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.877737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.879256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.879782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.881013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.883290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:26.908083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1179/2332] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:26.909848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:26.920276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:26.961437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098de96-532b-4006-9227-0f8290aca655 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:26.975091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:26.977083 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:26.978728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:26.979055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] PATH_INFO: `/v3/projects/4755b1cd34ff4b9ca86018d2cc423764/users/f39422beb8e443ab86880cfc83332162/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:26.985720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4755b1cd34ff4b9ca86018d2cc423764, user_id=f39422beb8e443ab86880cfc83332162, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:26.993216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce73d7-081d-4947-8b7e-a6690bd3433e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:27.005715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda39bc8-37bf-4cd8-84d5-25ff7ca2fb9f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:27.024229 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1180/2333] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:26 2022] PUT /identity/v3/projects/4755b1cd34ff4b9ca86018d2cc423764/users/f39422beb8e443ab86880cfc83332162/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:27.036513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:27.036822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:27.037078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:27.125309 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] MFA Rules not processed for user `f39422beb8e443ab86880cfc83332162`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:27.127494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:27.212239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:27.214868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:27.215677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:27.220484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] PATH_INFO: `/v3/users/3b7f2d721d2846b4815c85e11e29cb39` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:27.225951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7f2d721d2846b4815c85e11e29cb39)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:27.229847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:27.340863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1181/2334] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:27.348880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:27.352515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:27.412714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7f2d721d2846b4815c85e11e29cb39'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:27.414060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7f2d721d2846b4815c85e11e29cb39'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:27.466356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7f2d721d2846b4815c85e11e29cb39'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:27.482307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7f2d721d2846b4815c85e11e29cb39'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:27.483596 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7f2d721d2846b4815c85e11e29cb39'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:27.505566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39fe20-c8b0-4040-aea9-afc2b31fee35 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:27.511235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:27.511978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:27.512782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:27.513796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:27.516093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:27.547921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1154/2335] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:26 2022] DELETE /identity/v3/users/3b7f2d721d2846b4815c85e11e29cb39 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:27.567640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:27.580936 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:27.596523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1182/2336] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:27.708664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:27.708664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:27.842627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f46e3-ba68-4508-9057-8d9ba9c45be4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:27.854495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:27.855664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:27.857568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:27.858112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:27.860615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:28.023897 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:28.026005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:28.042645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1155/2337] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:28.501464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:28.505481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:28.558927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a5786-e5c9-468a-85c5-206b96cd5b7a service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:28.724544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:28.725477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:28.725762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:28.726036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] PATH_INFO: `/v3/projects/a92a88e0a5e8485c85ad2bbd417a884e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:28.728618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92a88e0a5e8485c85ad2bbd417a884e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:28.732625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:28.877477 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92a88e0a5e8485c85ad2bbd417a884e', 'request_id': 'req-4c1ba9cc-e162-42cc-b360-7552cae130bf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:28.892578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92a88e0a5e8485c85ad2bbd417a884e', 'request_id': 'req-4c1ba9cc-e162-42cc-b360-7552cae130bf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:28.919895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92a88e0a5e8485c85ad2bbd417a884e', 'request_id': 'req-4c1ba9cc-e162-42cc-b360-7552cae130bf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:28.948793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] The token cache is being invalidate because project a92a88e0a5e8485c85ad2bbd417a884e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:28.949325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:28.956390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:28.961130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1183/2338] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:28 2022] DELETE /identity/v3/projects/a92a88e0a5e8485c85ad2bbd417a884e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:28.962439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:28.977251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79555d98-0284-4fa6-ac43-c55db504328a service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:29.206922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:29.207913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:29.209752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:29.212825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] PATH_INFO: `/v3/users/36c2501fdf5c4e7c971087586ccb34d7` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:29.216247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c2501fdf5c4e7c971087586ccb34d7)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:29.223400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:29.344467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c2501fdf5c4e7c971087586ccb34d7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:29.345275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c2501fdf5c4e7c971087586ccb34d7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:29.378155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c2501fdf5c4e7c971087586ccb34d7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:29.389278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c2501fdf5c4e7c971087586ccb34d7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:29.390456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-894db72b-3991-457a-84a0-3d71ac5bd0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c2501fdf5c4e7c971087586ccb34d7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:29.452689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1156/2339] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:28 2022] DELETE /identity/v3/users/36c2501fdf5c4e7c971087586ccb34d7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:30.025180 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:30.027678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:30.090489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ba9cc-e162-42cc-b360-7552cae130bf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:30.298651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:30.299650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:30.300004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:30.300361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] PATH_INFO: `/v3/projects/385324af862049e9a18cd0c197a587df` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:30.301828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385324af862049e9a18cd0c197a587df)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:30.304209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:30.406950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385324af862049e9a18cd0c197a587df', 'request_id': 'req-4fd6174f-9ec0-4b03-a273-cb603e15d437'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:30.421032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385324af862049e9a18cd0c197a587df', 'request_id': 'req-4fd6174f-9ec0-4b03-a273-cb603e15d437'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:30.452396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385324af862049e9a18cd0c197a587df', 'request_id': 'req-4fd6174f-9ec0-4b03-a273-cb603e15d437'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:30.478548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] The token cache is being invalidate because project 385324af862049e9a18cd0c197a587df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:30.478959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:30.479701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-4fd6174f-9ec0-4b03-a273-cb603e15d437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:30.482368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1184/2340] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:30 2022] DELETE /identity/v3/projects/385324af862049e9a18cd0c197a587df => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:30.489178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:30.490236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:30.490763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:30.529691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:30.533249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:30.650724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1157/2341] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:30.660821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:30.661266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:30.661662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:30.690250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:30.691852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:30.720741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1185/2342] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:30.721888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:30.734358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27cc64-f609-41f0-ad99-b08c62bf3d06 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:30.740073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:30.740845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:30.741245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:30.741525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:30.742298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:30.742607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:30.744684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:30.772220 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1158/2343] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:30.773900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:30.784497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07875ba1-a5c4-4d9e-bf29-4ded95c070cb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:30.792443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:30.793259 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:30.793579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:30.793938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:30.794820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:30.796985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:30.838294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1186/2344] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:30 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:30.844164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:30.873847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc565b96-8b4a-4ba9-bb14-1dc7721426f6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.004874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.006204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.006802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.007384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.008832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.013029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.051020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1159/2345] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:30 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:31.055964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.078093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6fbf-feee-4496-b75b-bfdcecec65ba admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.086937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.088509 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.088867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.089399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.091916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.094980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.117779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1187/2346] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:31.126630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.147307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f613c-d8e7-429b-b20b-64eae84af089 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.155961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.156725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.157254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.157559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.158327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.159994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd77e4-5b15-4b23-9204-f9be94f71fb1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.172769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1160/2347] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:31.179388 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.198622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d07b63-6a76-4c8a-bf45-51fe0fbfedd5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.207866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.209943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.210464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.211177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] PATH_INFO: `/v3/projects/a3ba40c60aaf4acb8c0ac99186365505/users/dd1011b24f2a4721b90edc9f32f5408b/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.247753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ba40c60aaf4acb8c0ac99186365505, user_id=dd1011b24f2a4721b90edc9f32f5408b, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.253326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.285706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1188/2348] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:31 2022] PUT /identity/v3/projects/a3ba40c60aaf4acb8c0ac99186365505/users/dd1011b24f2a4721b90edc9f32f5408b/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:31.313647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.321841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.322606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.361491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] MFA Rules not processed for user `dd1011b24f2a4721b90edc9f32f5408b`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:31.362857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:31.453666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1161/2349] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:31.459316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.553058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc263800-c86c-4022-9a70-97d1d8b10eaf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.561884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.562923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.563393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.563950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.565336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.568184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.638927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1189/2350] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:31 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:31.641617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.660407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a44f7-3162-42c6-92a7-111bc2e7b763 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.835237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.836299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.836721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.837519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.838612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.842893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.892962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1162/2351] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:31 2022] POST /identity/v3/users => generated 303 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:31.896668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.913941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4054a63-3165-4141-b500-0d21e39c8b59 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.927527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.928364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.928774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.929263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.930177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.932248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.953803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.957669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:31.966949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1190/2352] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:31.970593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:31.982158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978acf4-669a-4b39-b3c7-19419d7e42ec admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.986799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e22f-d719-4d48-a63a-260a0279ddfe admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:31.990552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.991555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.991951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.992272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] PATH_INFO: `/v3/users/acafc70c254946a7ba6725179ca42a88` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:31.993741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acafc70c254946a7ba6725179ca42a88)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:31.996031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:31.996275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:31.998286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:31.998659 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:31.999047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] PATH_INFO: `/v3/projects/f7dfae7340cd44e5be18fb10a853a623/users/df8642999f3540ba995d598e8e0d75d3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.021000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dfae7340cd44e5be18fb10a853a623, user_id=df8642999f3540ba995d598e8e0d75d3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:32.024628 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:32.048316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1191/2353] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:31 2022] PUT /identity/v3/projects/f7dfae7340cd44e5be18fb10a853a623/users/df8642999f3540ba995d598e8e0d75d3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:32.054746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:32.094920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acafc70c254946a7ba6725179ca42a88'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:32.096604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acafc70c254946a7ba6725179ca42a88'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:32.115205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acafc70c254946a7ba6725179ca42a88'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:32.124493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acafc70c254946a7ba6725179ca42a88'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:32.125712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f777b9fc-779b-4a0a-9bd1-02d2969cab61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acafc70c254946a7ba6725179ca42a88'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:32.148252 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1163/2354] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:31 2022] DELETE /identity/v3/users/acafc70c254946a7ba6725179ca42a88 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:32.155077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.155639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.156113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.177878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:32.179552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:32.201640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6014d1-0119-4179-8db3-7fe22e1975ac admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:32.266834 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1164/2355] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:32.280750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:32.283765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:32.298852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:32.299651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.300011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.300520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.301464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:32.303243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:32.316768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1192/2356] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:32.320813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:32.323253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:32.337070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be421998-9fe9-4947-82e4-2dad863add83 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:32.349276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:32.354027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.354456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.355001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] PATH_INFO: `/v3/projects/f7dfae7340cd44e5be18fb10a853a623/users/df8642999f3540ba995d598e8e0d75d3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.359048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7dfae7340cd44e5be18fb10a853a623, user_id=df8642999f3540ba995d598e8e0d75d3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:32.364726 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26bb83-dce8-4a56-94c9-34abf08cb161 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:32.396961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1193/2357] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:32 2022] PUT /identity/v3/projects/f7dfae7340cd44e5be18fb10a853a623/users/df8642999f3540ba995d598e8e0d75d3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:32.406396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.406868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.407322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.454619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] MFA Rules not processed for user `df8642999f3540ba995d598e8e0d75d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:32.456231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:32.467628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6cfbf-6e4f-43cf-8ec4-eb0bf5d86545 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:32.551318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:32.552702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.553187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.553639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.573666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1194/2358] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:32.585645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:32.587822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:32.685659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:32.690882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:32.708081 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1165/2359] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:32.725463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9a49e-c7a4-4557-909c-e3ded527b0f8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:32.734593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:32.736114 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.736916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.737543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.757743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:32.760782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:32.796199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1195/2360] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:32.888496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:32.909880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e82fe-712f-41d2-8729-ef5495379fc1 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:32.915681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:32.920992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:32.920992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:32.920992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:32.921575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:33.004282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:33.005811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:33.023895 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1166/2361] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:33.375189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:33.377859 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:33.406765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9abb5-a280-4065-9ba4-8f02022a9dba service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:33.414950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:33.416012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:33.428712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:33.429318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] PATH_INFO: `/v3/projects/7834e91498524a179788e0220219795c` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:33.431716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7834e91498524a179788e0220219795c)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:33.439354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:33.521173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7834e91498524a179788e0220219795c', 'request_id': 'req-3444a154-17d4-4e17-9a1f-74b2689abd75'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.530857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7834e91498524a179788e0220219795c', 'request_id': 'req-3444a154-17d4-4e17-9a1f-74b2689abd75'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.545151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7834e91498524a179788e0220219795c', 'request_id': 'req-3444a154-17d4-4e17-9a1f-74b2689abd75'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.558970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] The token cache is being invalidate because project 7834e91498524a179788e0220219795c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:33.559454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.560420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.562747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1196/2362] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:33 2022] DELETE /identity/v3/projects/7834e91498524a179788e0220219795c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:33.567143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:33.588359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef777a-83b3-4209-8377-6a9119d74b92 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:33.693297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:33.694204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:33.694487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:33.694772 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] PATH_INFO: `/v3/users/641dff7e919b4767a087535a69b59a12` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:33.696831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641dff7e919b4767a087535a69b59a12)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:33.698826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:33.790328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641dff7e919b4767a087535a69b59a12'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.792384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641dff7e919b4767a087535a69b59a12'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.810754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641dff7e919b4767a087535a69b59a12'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.819682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641dff7e919b4767a087535a69b59a12'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.820525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641dff7e919b4767a087535a69b59a12'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:33.845355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1167/2363] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:33 2022] DELETE /identity/v3/users/641dff7e919b4767a087535a69b59a12 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:34.305546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:34.308824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:34.336009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a154-17d4-4e17-9a1f-74b2689abd75 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:34.422408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:34.423376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:34.423789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:34.424142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] PATH_INFO: `/v3/projects/925991f87bd94a3189047fcc100aa8bc` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:34.425759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=925991f87bd94a3189047fcc100aa8bc)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:34.428048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:34.484999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925991f87bd94a3189047fcc100aa8bc', 'request_id': 'req-7d40229a-15a8-4f4b-a6a6-edb802532e0f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.491300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925991f87bd94a3189047fcc100aa8bc', 'request_id': 'req-7d40229a-15a8-4f4b-a6a6-edb802532e0f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.505793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925991f87bd94a3189047fcc100aa8bc', 'request_id': 'req-7d40229a-15a8-4f4b-a6a6-edb802532e0f'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.530803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] The token cache is being invalidate because project 925991f87bd94a3189047fcc100aa8bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:34.531279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.532391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.535336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1197/2364] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:34 2022] DELETE /identity/v3/projects/925991f87bd94a3189047fcc100aa8bc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:34.541261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:34.545468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:34.584103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a739-8ec4-401b-875a-2d98b8318c48 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:34.694271 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:34.697293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:34.698377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:34.698852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] PATH_INFO: `/v3/users/f39422beb8e443ab86880cfc83332162` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:34.701747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39422beb8e443ab86880cfc83332162)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:34.704134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:34.779107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39422beb8e443ab86880cfc83332162'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.780558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39422beb8e443ab86880cfc83332162'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.805064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39422beb8e443ab86880cfc83332162'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.815454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39422beb8e443ab86880cfc83332162'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.816491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db6d715a-77b9-4db3-adfd-4f2dae5251cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39422beb8e443ab86880cfc83332162'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:34.837829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1168/2365] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:34 2022] DELETE /identity/v3/users/f39422beb8e443ab86880cfc83332162 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:35.219557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:35.223906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:35.259217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40229a-15a8-4f4b-a6a6-edb802532e0f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:35.344956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:35.347908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.348541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.349358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] PATH_INFO: `/v3/projects/4755b1cd34ff4b9ca86018d2cc423764` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.360219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4755b1cd34ff4b9ca86018d2cc423764)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:35.360219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:35.444662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4755b1cd34ff4b9ca86018d2cc423764', 'request_id': 'req-e03aa320-f631-43e9-8fc8-4e420e0b5436'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:35.451511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4755b1cd34ff4b9ca86018d2cc423764', 'request_id': 'req-e03aa320-f631-43e9-8fc8-4e420e0b5436'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:35.465934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4755b1cd34ff4b9ca86018d2cc423764', 'request_id': 'req-e03aa320-f631-43e9-8fc8-4e420e0b5436'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:35.480150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] The token cache is being invalidate because project 4755b1cd34ff4b9ca86018d2cc423764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:35.480617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:35.482796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-e03aa320-f631-43e9-8fc8-4e420e0b5436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:35.492036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1198/2366] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:35 2022] DELETE /identity/v3/projects/4755b1cd34ff4b9ca86018d2cc423764 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:35.495548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.496134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.498590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.540841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:35.544180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:35.694580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1169/2367] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:35.703708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.704014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.704366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.732392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:35.733962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:35.761185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1199/2368] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:35.766069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:35.778314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f59bb-66d7-4175-a351-08b98eaadacd None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:35.783407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:35.784166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.784524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.785060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.785605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:35.785910 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:35.787556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:35.802108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1170/2369] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:35.806736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:35.818903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac88da6-8b62-452f-94b0-da62eba14364 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:35.826199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:35.826858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.827161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.828256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.829042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:35.831194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:35.860232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1200/2370] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:35 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:35.865158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:35.876020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b71b7-bc81-4704-89b0-9be8617b352b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:35.955516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:35.956215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:35.956500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:35.956779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:35.957559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:35.959564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:35.988049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1171/2371] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:35 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:35.993584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.005787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4bab5-031c-4fdf-8ddf-995fa9e3b100 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.016840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.018351 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.018858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.019383 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.020833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.024748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.049191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.058099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1201/2372] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:36.069021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975c397-58da-4981-9bae-4aaeed4b7d83 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.076296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.077035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.077322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.077786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.078551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.081073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d5846-cc2c-4162-84a0-97f8f315268d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.093047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1172/2373] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:36.108675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.125386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5551e91-0d82-45a3-b5e8-4c41d536e1bc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.130811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.132493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.132493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.132493 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] PATH_INFO: `/v3/projects/9336e095a2204becb1aeb1139797da22/users/858ff4f82764425b8b9623f4ea89aae7/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.162863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9336e095a2204becb1aeb1139797da22, user_id=858ff4f82764425b8b9623f4ea89aae7, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.167265 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.207782 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1202/2374] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:36 2022] PUT /identity/v3/projects/9336e095a2204becb1aeb1139797da22/users/858ff4f82764425b8b9623f4ea89aae7/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:36.220797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.221324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.221701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.252030 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] MFA Rules not processed for user `858ff4f82764425b8b9623f4ea89aae7`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:36.253447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:36.346956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1173/2375] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:36.356916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.432431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7baba3-bd9d-4184-a0a1-e50ff115558b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.438020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.438692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.438973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.439244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.440076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.442031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.480423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1203/2376] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:36 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:36.483322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.503752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6d11e-4fcf-485e-896f-a340e6a9a41a None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.589055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.590739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.591457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.591457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.592660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.596095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.622862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1174/2377] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:36 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:36.627992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.641825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c015d-39a7-489a-b470-2cf905e573d6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.649543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.650627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.651121 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.651588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.653587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.656372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.674966 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1204/2378] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:36.679250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.693670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013e764-e00a-4d9e-9c2f-5429f400b6a7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.702203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.703721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.704205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.704669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] PATH_INFO: `/v3/projects/944d6179597c4807bcbe7530be7bbeab/users/e24398a510ec4b93b12d3092e7fbcbed/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.731652 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=944d6179597c4807bcbe7530be7bbeab, user_id=e24398a510ec4b93b12d3092e7fbcbed, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.737289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.756602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1175/2379] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:36 2022] PUT /identity/v3/projects/944d6179597c4807bcbe7530be7bbeab/users/e24398a510ec4b93b12d3092e7fbcbed/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:36.760923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.772807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5bd6d-586e-40bc-92fa-c7a96670d33e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.839424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.840369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.840599 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.841017 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.841780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.843607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.862016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1205/2380] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:36.866359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.880726 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67613ff0-4822-4da8-bf4c-a6527fe887ec admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.890521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:36.892331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.892724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.893162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] PATH_INFO: `/v3/projects/944d6179597c4807bcbe7530be7bbeab/users/e24398a510ec4b93b12d3092e7fbcbed/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.896059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944d6179597c4807bcbe7530be7bbeab, user_id=e24398a510ec4b93b12d3092e7fbcbed, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:36.899521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7fb7b-a51c-423b-9f34-6dd1945b8645 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:36.909398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:36.911665 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:36.913698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1176/2381] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:36 2022] PUT /identity/v3/projects/944d6179597c4807bcbe7530be7bbeab/users/e24398a510ec4b93b12d3092e7fbcbed/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:36.930924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:36.931209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a2465-75cf-4f7f-828b-c375bd66f13d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:36.931320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:36.931487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:36.964751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] MFA Rules not processed for user `e24398a510ec4b93b12d3092e7fbcbed`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:36.966722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.013060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:37.014139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.014484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.014839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] PATH_INFO: `/v3/users/dd1011b24f2a4721b90edc9f32f5408b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.016395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd1011b24f2a4721b90edc9f32f5408b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:37.018601 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:37.060448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1177/2382] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:37.072800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:37.074840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.078381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd1011b24f2a4721b90edc9f32f5408b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.096959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd1011b24f2a4721b90edc9f32f5408b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.097773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd1011b24f2a4721b90edc9f32f5408b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.105416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd1011b24f2a4721b90edc9f32f5408b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.114836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62bb3c32-08c2-4489-b0bd-9b46215f6baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd1011b24f2a4721b90edc9f32f5408b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.125649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1206/2383] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:36 2022] DELETE /identity/v3/users/dd1011b24f2a4721b90edc9f32f5408b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:37.132199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.132755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.133197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.162077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:37.163433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b1cb7-0744-4924-b358-76c4924b2290 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:37.164134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.239921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:37.241046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.241527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.241999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.245643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.256384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1207/2384] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:37.270181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:37.273766 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.342282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:37.344837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:37.359365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1178/2385] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:37.366715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e28ad-274c-4f92-9a48-5486e6e8dd0b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:37.373184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:37.374189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.374588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.375101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.388406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:37.390293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:37.401186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1208/2386] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:37.766238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:37.768332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.790362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4607-d86c-4822-b15c-9b875be9cabc service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:37.803269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:37.804368 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.804718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.805164 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] PATH_INFO: `/v3/projects/a3ba40c60aaf4acb8c0ac99186365505` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.806787 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ba40c60aaf4acb8c0ac99186365505)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:37.809851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:37.856099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:37.857710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.872522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d23fe-4791-448d-9e89-f23862a2b6c0 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:37.879606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ba40c60aaf4acb8c0ac99186365505', 'request_id': 'req-f64512b9-907f-462c-b049-fcc9edf7beec'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.888041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ba40c60aaf4acb8c0ac99186365505', 'request_id': 'req-f64512b9-907f-462c-b049-fcc9edf7beec'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.897681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ba40c60aaf4acb8c0ac99186365505', 'request_id': 'req-f64512b9-907f-462c-b049-fcc9edf7beec'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.913640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] The token cache is being invalidate because project a3ba40c60aaf4acb8c0ac99186365505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:37.914189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.915210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:37.920918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1179/2387] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:37 2022] DELETE /identity/v3/projects/a3ba40c60aaf4acb8c0ac99186365505 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:37.921922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:37.923376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:37.938430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:37.939520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:37.939804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:37.940166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] PATH_INFO: `/v3/users/858ff4f82764425b8b9623f4ea89aae7` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:37.941455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858ff4f82764425b8b9623f4ea89aae7)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:37.943436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:38.003681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858ff4f82764425b8b9623f4ea89aae7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.010207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64512b9-907f-462c-b049-fcc9edf7beec admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:38.019479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:38.020527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.021048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.021533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] PATH_INFO: `/v3/users/df8642999f3540ba995d598e8e0d75d3` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.023117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8642999f3540ba995d598e8e0d75d3)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:38.025641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858ff4f82764425b8b9623f4ea89aae7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.026381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858ff4f82764425b8b9623f4ea89aae7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.026558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:38.036397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858ff4f82764425b8b9623f4ea89aae7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.046311 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9c1f6dc7-f1e1-45a7-b17c-7c5d80a1e5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858ff4f82764425b8b9623f4ea89aae7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.055792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1209/2388] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:37 2022] DELETE /identity/v3/users/858ff4f82764425b8b9623f4ea89aae7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:38.062704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.063173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.063619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.089162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:38.091734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.103998 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8642999f3540ba995d598e8e0d75d3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.105138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8642999f3540ba995d598e8e0d75d3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.126570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8642999f3540ba995d598e8e0d75d3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.139090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8642999f3540ba995d598e8e0d75d3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.140189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8642999f3540ba995d598e8e0d75d3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.159890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1180/2389] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:37 2022] DELETE /identity/v3/users/df8642999f3540ba995d598e8e0d75d3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:38.176462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1210/2390] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:38.191656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:38.193901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.278079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda913b9-56c4-4d02-a377-a787c1b78f3f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:38.284516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:38.285669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.286150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.286631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.376979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:38.379393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:38.409135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1181/2391] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:38.467823 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:38.469686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.539862 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a1dc5-8730-407e-915f-6e7ba30b2fd4 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:38.544954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:38.545727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.546092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.546438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.548640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.667905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:38.669625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272da47b-cc3c-44a5-8785-865d6bcfe228 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:38.695048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1211/2392] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:38.708442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:38.710632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.735068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345ea1af-af86-42e4-855e-b248f24b2fad service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:38.744142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:38.746017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.746598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.747305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] PATH_INFO: `/v3/projects/f7dfae7340cd44e5be18fb10a853a623` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.756703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7dfae7340cd44e5be18fb10a853a623)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:38.761123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:38.854472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7dfae7340cd44e5be18fb10a853a623', 'request_id': 'req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.867122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7dfae7340cd44e5be18fb10a853a623', 'request_id': 'req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.881322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7dfae7340cd44e5be18fb10a853a623', 'request_id': 'req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.905584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] The token cache is being invalidate because project f7dfae7340cd44e5be18fb10a853a623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:38.905865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.906756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:38.908638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1182/2393] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:38 2022] DELETE /identity/v3/projects/f7dfae7340cd44e5be18fb10a853a623 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:38.919415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d95-119a-486b-bb45-fe895f4d5c22 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:38.919415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d95-119a-486b-bb45-fe895f4d5c22 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:38.919415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad98d95-119a-486b-bb45-fe895f4d5c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:38.920839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:38.923022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:38.939455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-bad98d95-119a-486b-bb45-fe895f4d5c22 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:38.940703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-bad98d95-119a-486b-bb45-fe895f4d5c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.023041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1212/2394] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:39.024137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e89b36-9391-4a1a-b7d0-32fe80025b1e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.032736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.034296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.034785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.035275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] PATH_INFO: `/v3/projects/9336e095a2204becb1aeb1139797da22` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.037101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9336e095a2204becb1aeb1139797da22)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.037851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.038238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.038537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.039436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.058298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:39.060119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.069120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1213/2395] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:39.073596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.084565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7bb7f-df75-43d2-be80-166164faf01f None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.091234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9336e095a2204becb1aeb1139797da22', 'request_id': 'req-4cf608dc-6558-4049-9330-f8bab07f3895'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.098524 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9336e095a2204becb1aeb1139797da22', 'request_id': 'req-4cf608dc-6558-4049-9330-f8bab07f3895'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.110046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9336e095a2204becb1aeb1139797da22', 'request_id': 'req-4cf608dc-6558-4049-9330-f8bab07f3895'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.125184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] The token cache is being invalidate because project 9336e095a2204becb1aeb1139797da22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:39.125641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.126549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.129850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1183/2396] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:38 2022] DELETE /identity/v3/projects/9336e095a2204becb1aeb1139797da22 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:39.134417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.136165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.170377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.171149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.171424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.171696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.172435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:39.172739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.174382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.187575 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1214/2397] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:39.192906 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.195350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.208389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e029f49-a93e-4d5c-9030-9f86d6f05fec admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.210026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf608dc-6558-4049-9330-f8bab07f3895 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.214738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.217100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.217341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.219879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] PATH_INFO: `/v3/users/e24398a510ec4b93b12d3092e7fbcbed` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.219879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24398a510ec4b93b12d3092e7fbcbed)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.221522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.221918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.222555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.222893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.223249 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.224097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.226762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.263737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1215/2398] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:39.268148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.288567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24398a510ec4b93b12d3092e7fbcbed'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.289402 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24398a510ec4b93b12d3092e7fbcbed'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.307975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24398a510ec4b93b12d3092e7fbcbed'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.317293 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24398a510ec4b93b12d3092e7fbcbed'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.318046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24398a510ec4b93b12d3092e7fbcbed'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.335119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1184/2399] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:39 2022] DELETE /identity/v3/users/e24398a510ec4b93b12d3092e7fbcbed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:39.377897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c67ba-cc44-4248-bb76-09a28fed865e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.490758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.492045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.492582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.493127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.494631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.499406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.529951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1216/2400] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:39.534622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.537821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.559639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8294b-0dde-40c8-a0a0-fe89f1f8c22d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.566649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.567667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.568138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.568616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.569970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.572797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.586837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1185/2401] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:39.593547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.608582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c7b82-dac6-49b0-8089-483848010f1c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.616716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.617537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.618033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.624483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.626057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.629428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8919a3b4-e441-4656-b24f-0eb2175e35ed admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.647674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1217/2402] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:39.652151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.663720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c150ef-e3d5-438e-bbc9-f482a92da10a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.669544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.670425 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.670715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.670973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] PATH_INFO: `/v3/projects/27ee58b686df460fa52e03fc5179faab/users/071167cb57ec465984f53604748baca0/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.688300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] RBAC: Authorizing `identity:create_grant(project_id=27ee58b686df460fa52e03fc5179faab, user_id=071167cb57ec465984f53604748baca0, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.690968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.709833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1186/2403] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:39 2022] PUT /identity/v3/projects/27ee58b686df460fa52e03fc5179faab/users/071167cb57ec465984f53604748baca0/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:39.727880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.728240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.728617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.747249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.755588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.771149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] MFA Rules not processed for user `071167cb57ec465984f53604748baca0`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:39.772731 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:39.852657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfd529-a9c7-4a02-b39e-43d73f4839be admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.858314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.859246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.859527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.859803 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] PATH_INFO: `/v3/projects/944d6179597c4807bcbe7530be7bbeab` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.861242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=944d6179597c4807bcbe7530be7bbeab)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.863217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.872811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1218/2404] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:39.877282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.890962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95761c27-3ffb-4e3d-9ff6-e865625346a8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:39.896403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:39.897105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:39.897435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:39.897696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:39.898429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:39.900624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:39.936302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1219/2405] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:39.941471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944d6179597c4807bcbe7530be7bbeab', 'request_id': 'req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.942703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:39.952136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944d6179597c4807bcbe7530be7bbeab', 'request_id': 'req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.965354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944d6179597c4807bcbe7530be7bbeab', 'request_id': 'req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.985855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] The token cache is being invalidate because project 944d6179597c4807bcbe7530be7bbeab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:39.986509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.987710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-85c1764e-3e57-4de8-9f5e-bebdf694a6ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:39.992984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1187/2406] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:39 2022] DELETE /identity/v3/projects/944d6179597c4807bcbe7530be7bbeab => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:40.000317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e2e5-c184-428e-80e0-13ee271351e9 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.001348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e2e5-c184-428e-80e0-13ee271351e9 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.001471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02e2e5-c184-428e-80e0-13ee271351e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.049807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0f02e2e5-c184-428e-80e0-13ee271351e9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:40.054126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0f02e2e5-c184-428e-80e0-13ee271351e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.064839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee998c8-fd27-4f58-b6fa-566e71f47ffd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.065295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1188/2407] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:40.073819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.074332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.074699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.074980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.075097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.075393 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.075923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.076777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.078885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.097086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:40.098406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.104232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1220/2408] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:39 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:40.110716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.115089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.116289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1189/2409] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:40.122000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.131196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859021c-a1a2-43a4-82f3-da43e9dc2e27 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.135994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf38f-3cfa-4827-bf70-04cddacf0a23 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.137955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328058-5235-45da-b906-d869d040218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.139399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328058-5235-45da-b906-d869d040218e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.139899 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328058-5235-45da-b906-d869d040218e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.140718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0328058-5235-45da-b906-d869d040218e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.141890 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0328058-5235-45da-b906-d869d040218e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.144697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.145033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0328058-5235-45da-b906-d869d040218e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.145558 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.145822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.146210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.147205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:40.147539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.149626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.164444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1221/2410] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:24:40.164747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1190/2411] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:40.171270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.171479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328058-5235-45da-b906-d869d040218e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.181744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50d39-c608-44b4-8290-cbb48e086ba7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.187559 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0328058-5235-45da-b906-d869d040218e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.187980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.188662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.189006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.189250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.189987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.192033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.193564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.194656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.194941 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.195230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] PATH_INFO: `/v3/projects/4c00093acd604e3db4b546ae2fae0ab6/users/5ddf9b46fe4f42c1b92834e510e14f33/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.213600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c00093acd604e3db4b546ae2fae0ab6, user_id=5ddf9b46fe4f42c1b92834e510e14f33, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.217965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.222497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1191/2412] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:40 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:40.230018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.242555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1222/2413] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:40 2022] PUT /identity/v3/projects/4c00093acd604e3db4b546ae2fae0ab6/users/5ddf9b46fe4f42c1b92834e510e14f33/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:40.247697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.318891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c04e97-f30b-4c5d-b71e-c0f56d2fb1c2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.348391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb51c1-d4a8-4a1b-8cb4-b114c82595a1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.353990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.354826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.355279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.355734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.356914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.359361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.372925 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1223/2414] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:40.377539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.390203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86621e-f8f8-42b2-8811-699ec1f24a1a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.395358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.396262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.396543 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.396854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] PATH_INFO: `/v3/projects/4c00093acd604e3db4b546ae2fae0ab6/users/5ddf9b46fe4f42c1b92834e510e14f33/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.399025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c00093acd604e3db4b546ae2fae0ab6, user_id=5ddf9b46fe4f42c1b92834e510e14f33, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.401832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330133dd-ac67-4b35-9d2d-5ab39ca4e43d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.411601 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.412294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.412585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.412864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.413626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.414151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1224/2415] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:40 2022] PUT /identity/v3/projects/4c00093acd604e3db4b546ae2fae0ab6/users/5ddf9b46fe4f42c1b92834e510e14f33/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:40.415683 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.431245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.431796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.432254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.442824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1192/2416] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:40 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:40.454502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.463224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0d3b3-9030-4bb7-8944-ba2dd28c01e8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.471196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] MFA Rules not processed for user `5ddf9b46fe4f42c1b92834e510e14f33`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:40.472423 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.539143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.539825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.540111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.540401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.541206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.542858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.554614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1193/2417] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:40.559710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.564813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1225/2418] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:40.571845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79261fa-47ae-418f-bbb5-a182c1536c53 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.576612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.578701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.578872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.579575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.579859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.580134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.580878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.582545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.594641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1194/2419] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:40.599056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.615916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454fd6-aa49-4e85-a7b7-349bb842c94d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.623359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.624325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.624612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.624940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] PATH_INFO: `/v3/projects/99a6291529004414be900daac973b38a/users/a95e4093e61647bc949fa7393dcd562c/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.653741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=99a6291529004414be900daac973b38a, user_id=a95e4093e61647bc949fa7393dcd562c, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.658225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbd780-3f43-4055-8723-abac754fc4be admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.671999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f7f91-2676-4bd8-89af-ded7a22995ef None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.678794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1195/2420] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:40 2022] PUT /identity/v3/projects/99a6291529004414be900daac973b38a/users/a95e4093e61647bc949fa7393dcd562c/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:40.693023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.693445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.693801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.739126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] MFA Rules not processed for user `a95e4093e61647bc949fa7393dcd562c`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:40.741236 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.755992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.757154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.757647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.758106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.843048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.844535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.853990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1196/2421] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:40.862347 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:40.864785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1226/2422] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:40.864956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:40.898530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be85a8-5593-436f-9813-bb231c13a7cd None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:40.905639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:40.906311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:40.906599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:40.906883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:40.925955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:40.928862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:40.946021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1197/2423] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:41.035629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:41.136234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0fa49-1671-4453-8509-f27782c91da5 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:41.146649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:41.148161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:41.149004 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:41.149563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] PATH_INFO: `/v3/users/071167cb57ec465984f53604748baca0` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:41.151590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=071167cb57ec465984f53604748baca0)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:41.156749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:41.193999 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:41.196516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:41.267727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071167cb57ec465984f53604748baca0'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:41.291632 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd95d78-a0d5-45d7-a78d-43367e499c3a service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:41.298233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:41.298882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:41.298882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:41.299462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:41.301341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:41.326727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071167cb57ec465984f53604748baca0'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:41.328320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071167cb57ec465984f53604748baca0'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:41.352858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071167cb57ec465984f53604748baca0'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:41.375754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-dc5411ca-ad36-4a82-9998-e8c4248f70e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071167cb57ec465984f53604748baca0'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:41.397355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1227/2424] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:41 2022] DELETE /identity/v3/users/071167cb57ec465984f53604748baca0 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:41.402177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:41.403366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:41.403508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:41.404340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:41.405207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:41.417915 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1198/2425] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:41.437843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:41.440677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:41.554122 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1228/2426] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:41.570345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:41.571828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:41.584646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561584a-424b-41e2-a23c-f105b964211b service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:41.655287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:41.655961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:41.656247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:41.656529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:41.671667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:41.673409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:41.690398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1199/2427] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:42.085046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:42.086964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:42.109014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2f3db-f9b3-4e90-9291-a4264fb8ea92 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:42.117093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:42.118860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:42.119387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:42.119885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] PATH_INFO: `/v3/projects/27ee58b686df460fa52e03fc5179faab` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:42.122979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=27ee58b686df460fa52e03fc5179faab)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:42.126880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:42.188197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27ee58b686df460fa52e03fc5179faab', 'request_id': 'req-91df49d7-844e-4355-99e1-ec51f8c3cddf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.195479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27ee58b686df460fa52e03fc5179faab', 'request_id': 'req-91df49d7-844e-4355-99e1-ec51f8c3cddf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.206061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27ee58b686df460fa52e03fc5179faab', 'request_id': 'req-91df49d7-844e-4355-99e1-ec51f8c3cddf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.226336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] The token cache is being invalidate because project 27ee58b686df460fa52e03fc5179faab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:42.226856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.227972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.231514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1229/2428] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:42 2022] DELETE /identity/v3/projects/27ee58b686df460fa52e03fc5179faab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:42.237799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:42.253884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f80b-b8e5-4fb8-a69e-c02bfa16010d service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:42.328146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:42.329460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:42.329867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:42.330327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] PATH_INFO: `/v3/users/5ddf9b46fe4f42c1b92834e510e14f33` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:42.332433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddf9b46fe4f42c1b92834e510e14f33)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:42.336294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:42.395129 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddf9b46fe4f42c1b92834e510e14f33'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.397505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddf9b46fe4f42c1b92834e510e14f33'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.419406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddf9b46fe4f42c1b92834e510e14f33'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.431403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddf9b46fe4f42c1b92834e510e14f33'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.432459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c5070bbc-c0b8-41e5-9dc0-a5edababc08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddf9b46fe4f42c1b92834e510e14f33'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:42.461152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1200/2429] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:42 2022] DELETE /identity/v3/users/5ddf9b46fe4f42c1b92834e510e14f33 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:42.866625 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:42.870210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:42.889868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df49d7-844e-4355-99e1-ec51f8c3cddf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:42.968000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:42.968993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:42.969279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:42.969845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] PATH_INFO: `/v3/projects/4c00093acd604e3db4b546ae2fae0ab6` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:42.971123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c00093acd604e3db4b546ae2fae0ab6)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:42.973160 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.027027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c00093acd604e3db4b546ae2fae0ab6', 'request_id': 'req-02697f9d-bff2-4f1a-9126-a08bfd08afd8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:43.033998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c00093acd604e3db4b546ae2fae0ab6', 'request_id': 'req-02697f9d-bff2-4f1a-9126-a08bfd08afd8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:43.045285 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c00093acd604e3db4b546ae2fae0ab6', 'request_id': 'req-02697f9d-bff2-4f1a-9126-a08bfd08afd8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:43.064521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] The token cache is being invalidate because project 4c00093acd604e3db4b546ae2fae0ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:43.064808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:43.065566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02697f9d-bff2-4f1a-9126-a08bfd08afd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:43.067057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1230/2430] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:42 2022] DELETE /identity/v3/projects/4c00093acd604e3db4b546ae2fae0ab6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:43.072370 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.072666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.073000 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.092169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:43.093408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.169207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1201/2431] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:43.178135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887238c-b582-43b1-9865-e74802b08879 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.178729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887238c-b582-43b1-9865-e74802b08879 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.178729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887238c-b582-43b1-9865-e74802b08879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.198470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5887238c-b582-43b1-9865-e74802b08879 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:43.200343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5887238c-b582-43b1-9865-e74802b08879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.208684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1231/2432] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:43.213853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.225023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b27256-cff4-42ae-9e9d-91a1d6f977cf None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.230091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.231147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.231431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.231713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.232466 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:24:43.232841 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.234432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.247656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1202/2433] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:24:43.251996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887238c-b582-43b1-9865-e74802b08879 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.262747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887238c-b582-43b1-9865-e74802b08879 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.267666 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.268327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.268609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.268885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.269651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.271561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.300728 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1232/2434] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:43.308738 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.319331 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899a296-dec1-4cdd-b478-5c0119e16d8c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.365193 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.367532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.380671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.381426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.381729 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.381966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.382972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.384653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.408721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1203/2435] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:43.412826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.423058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bebdac-a96b-47df-b818-e704a40b7b0b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.427820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.428495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.428781 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.429353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.430763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.431489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.435136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71ed2b-0fde-45ba-8081-c23b8cb3afeb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.438939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.439744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.440028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.440302 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.442136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.443174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1204/2436] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:43.447253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.453579 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.455028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.459329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba90ff0-9862-4907-8699-123f4ceac886 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.465346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.465346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.465346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.465346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.471636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.471636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0487b33-3ff9-4313-b123-b8ed20a1555f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.471821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1233/2437] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:43.483676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1205/2438] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:43.488594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.506800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f309-4f18-4e0c-bc1e-60c7883c1ff3 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.512933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.514046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.514336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.514617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] PATH_INFO: `/v3/projects/ea62cd04ab55447db05e3f8e32a73e58/users/844734961c2c4264b2d3710553f6cbfd/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.535107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea62cd04ab55447db05e3f8e32a73e58, user_id=844734961c2c4264b2d3710553f6cbfd, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.538170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf5b02-4b1b-42dd-aacd-5cfae2131387 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.557213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1234/2439] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:43 2022] PUT /identity/v3/projects/ea62cd04ab55447db05e3f8e32a73e58/users/844734961c2c4264b2d3710553f6cbfd/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:43.577255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.577764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.578249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.596637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc79e-8960-4bfc-9ed9-300e82b55de4 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.597036 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc79e-8960-4bfc-9ed9-300e82b55de4 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.597341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bc79e-8960-4bfc-9ed9-300e82b55de4 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.599646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1235/2440] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:24:43.607051 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.607680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.608387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.618041 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] MFA Rules not processed for user `844734961c2c4264b2d3710553f6cbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:43.619571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.676209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:43.678540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.735095 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1206/2441] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:43.754825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.813233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1236/2442] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:43.830690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.832499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:43.867920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276675ba-ef5c-41da-92d1-2e2b91cb7978 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.875624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.876950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.877409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.877855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.879502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.883274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.917538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bfdba-27e6-4a3b-a2c8-d73aabe1c4b2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:43.923623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1207/2443] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:43.924857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:43.925762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:43.926476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:43.926877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:43.929114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:43.946846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:43.950428 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:43.971648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1237/2444] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:44.029509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb234c71-ca51-4400-978c-9fc88c2b8305 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.034487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.035179 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.035460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.035735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.036457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.039035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc6950-019a-4477-9adf-1f810e1034ef admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.062400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1208/2445] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:43 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:44.066452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.070057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b61e-c049-44a2-97bd-ea905a22d3bb None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.070421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b61e-c049-44a2-97bd-ea905a22d3bb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.070766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b61e-c049-44a2-97bd-ea905a22d3bb None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.072691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1209/2446] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:24:44.079492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.079933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.080214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.095498 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038906-cc9c-4f75-899a-ff1e14f08a1f service glance] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.104346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:44.105789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.107458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.108605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.109183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.109683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.111090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.114325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.128508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1238/2447] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:44.133722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.151441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8e89b-ac25-4fa2-9571-02ffc0f8ebb5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.161003 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.162177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.162736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.163255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.164669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.168867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.173809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1210/2448] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:44.182398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1239/2449] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:44.190941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.191888 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.193917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.205906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005257-cd53-40ed-8ed7-cb42de413647 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.208109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9948a-e85f-4f7c-9651-ae3dfa9d7f29 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.212870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.213849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.214483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.215536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.215943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.216097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] PATH_INFO: `/v3/projects/94b15e0995aa401aa24a96261d8d850e/users/6650ab4af7394b4187cd5309b4a31ac5/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.216446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.217025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.231237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.232719 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1e7d7-a9bc-45a7-8a8c-c61eac7f0124 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.236510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b15e0995aa401aa24a96261d8d850e, user_id=6650ab4af7394b4187cd5309b4a31ac5, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.239316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0de9a-c45c-4cfa-b775-ea1ffe6d7fa8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.242382 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1240/2450] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:44.254811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1211/2451] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:44 2022] PUT /identity/v3/projects/94b15e0995aa401aa24a96261d8d850e/users/6650ab4af7394b4187cd5309b4a31ac5/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:44.266129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.266446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.266716 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.305466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] MFA Rules not processed for user `6650ab4af7394b4187cd5309b4a31ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:44.307604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.357613 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec12fc-c184-494d-b941-29439af97cd1 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.358223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec12fc-c184-494d-b941-29439af97cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.358786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec12fc-c184-494d-b941-29439af97cd1 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.362548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1212/2452] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:24:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:24:44.369885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.370529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.371630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.390996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1241/2453] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:44.395634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.402636 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:44.404980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.462367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64b622-0395-453c-a9fb-fafb6a4d4ba9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.468208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.468889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.469207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.469594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.470183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.472131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.499936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1213/2454] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:44.510294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1242/2455] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:24:44.512341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.512582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.575545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec4ca-572c-44c3-9e0b-70a2e19b0a7d None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.580186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d2c67-a673-4d92-a05a-75e41aba513a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.585216 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.585897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.586176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.586453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.587170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.589288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.613892 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1243/2456] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:24:44.618076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.629760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b886dc3-9d3d-4e92-a62f-468624880975 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.633281 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.633942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.634227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.634500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.635667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.636952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.638224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.638654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.639472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.641202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.651567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1244/2457] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:44.656926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.668185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a53d6-a3f0-4d89-b3ac-4476946c2f08 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.675876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.675876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.675876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.675876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] PATH_INFO: `/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1/users/daad470ceb23433894a5c6ad8d8a4e11/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.691044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd6f32dd7ec40f68cee6f008fb6b2e1, user_id=daad470ceb23433894a5c6ad8d8a4e11, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.693748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.706120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.707575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.708506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1245/2458] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:44 2022] PUT /identity/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1/users/daad470ceb23433894a5c6ad8d8a4e11/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:24:44.712668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.720666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1214/2459] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:44.783855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b81439-3830-4069-87c0-b95217365eaa admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.786974 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.788645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.789762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.790503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.790845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.791192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.792007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.793780 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.813422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1246/2460] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:24:44.814569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.827011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941def-bae4-43cb-a83d-cabfd23c08ba admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.832933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.833838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.834120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.834398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] PATH_INFO: `/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1/users/daad470ceb23433894a5c6ad8d8a4e11/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.836527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd6f32dd7ec40f68cee6f008fb6b2e1, user_id=daad470ceb23433894a5c6ad8d8a4e11, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.839438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18042-cd2c-41d8-ba34-b15cf3377e69 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.853676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1247/2461] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:24:44 2022] PUT /identity/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1/users/daad470ceb23433894a5c6ad8d8a4e11/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:44.864104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.864438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.864664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.872828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3862d-c9f1-47af-ae16-7ecd83fede1b service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:44.893722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] MFA Rules not processed for user `daad470ceb23433894a5c6ad8d8a4e11`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:44.894924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.943329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:44.943994 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:44.944282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:44.944562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:44.947734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:44.961824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:44.963457 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:44.980258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1215/2462] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:44.985130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1248/2463] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:44.991505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:44.993444 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:45.060939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8682d4-f17a-4104-a612-3404c6e98cc5 service placement] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:45.064727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:45.065481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:45.065827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:45.066165 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:45.139094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:45.140568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:45.150623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1216/2464] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:48.834662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:48.836144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:48.848453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86bfc9-8e3b-4281-abb1-739d772e3fb8 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:48.852233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:48.852880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:48.853194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:48.853471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:48.914825 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:48.916267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:48.926014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1249/2465] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:50.487348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:50.489096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:50.556307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bc860-967d-48ff-9e86-b13386865828 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:50.561718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:50.562611 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:50.562912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:50.563170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] PATH_INFO: `/v3/users/a95e4093e61647bc949fa7393dcd562c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:50.564394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a95e4093e61647bc949fa7393dcd562c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:50.566355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:50.627435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a95e4093e61647bc949fa7393dcd562c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:50.628676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a95e4093e61647bc949fa7393dcd562c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:50.629416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:50.641555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a95e4093e61647bc949fa7393dcd562c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:50.645529 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58412b70-0b2f-463a-9a1f-b95a10f433b4 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:50.649437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a95e4093e61647bc949fa7393dcd562c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:50.649816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:50.650160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1d57a009-882c-4268-9691-168312d06365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a95e4093e61647bc949fa7393dcd562c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:50.650471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:50.650753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:50.651024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:50.652881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:50.666747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1217/2466] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:50 2022] DELETE /identity/v3/users/a95e4093e61647bc949fa7393dcd562c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:50.671831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:50.672432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:50.672739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:50.673077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:50.673335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:50.686186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1250/2467] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:24:50.695443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:50.696720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:50.767349 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1218/2468] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:24:50.779787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:50.781372 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:50.852703 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e65a57-180f-4ba7-9e0f-c28d92840359 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:50.921060 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:50.922169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:50.922508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:50.922919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:50.935408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:50.937621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:50.951033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1251/2469] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:51.307475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:51.309162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:51.323567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6c06d-f504-453e-952a-413eccf26593 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:51.331593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:51.332922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:51.332922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:51.333251 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] PATH_INFO: `/v3/projects/99a6291529004414be900daac973b38a` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:51.335391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99a6291529004414be900daac973b38a)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:51.337699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:51.396878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99a6291529004414be900daac973b38a', 'request_id': 'req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:51.402665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99a6291529004414be900daac973b38a', 'request_id': 'req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:51.411810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99a6291529004414be900daac973b38a', 'request_id': 'req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:51.424171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] The token cache is being invalidate because project 99a6291529004414be900daac973b38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:51.424468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:51.425161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8142ce4d-ddcc-4c9e-b8ef-801605b08ba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:51.426981 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1219/2470] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:51 2022] DELETE /identity/v3/projects/99a6291529004414be900daac973b38a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:54.541027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:54.542522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:54.554258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25671125-7146-47ea-b08c-cd1312b82b1f service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:54.615560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:54.616340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:54.616947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:54.616947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:54.620618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:54.630472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:54.631909 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:54.641386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1252/2471] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:55.538454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b330-e794-4536-962f-0801aab80947 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:55.538912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b330-e794-4536-962f-0801aab80947 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:55.539002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3b330-e794-4536-962f-0801aab80947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:55.559394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-47d3b330-e794-4536-962f-0801aab80947 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:55.560583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-47d3b330-e794-4536-962f-0801aab80947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:55.615951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1220/2472] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:24:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:55.628662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:55.630173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:55.723104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de4798-4f94-4ff9-ab3d-20e483281da1 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:55.736663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:55.737390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:55.737740 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:55.738090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:55.756171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:55.757975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:55.768079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1253/2473] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:24:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 15 04:24:56.818914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3b330-e794-4536-962f-0801aab80947 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:56.820699 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-47d3b330-e794-4536-962f-0801aab80947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:56.902901 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3b330-e794-4536-962f-0801aab80947 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:56.909853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:56.910520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:56.910813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:56.911092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:56.913022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:56.991701 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:56.995805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78750f5-7d27-452b-8eb5-ca319cefc440 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:57.004784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1221/2474] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:57.742986 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:57.744752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:57.816061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea4a9f-be3b-4bfe-b83a-b62b692e5cdf service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:57.821553 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:57.822434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:57.822739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:57.822971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] PATH_INFO: `/v3/users/844734961c2c4264b2d3710553f6cbfd` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:57.824217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=844734961c2c4264b2d3710553f6cbfd)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:57.826254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:57.895043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844734961c2c4264b2d3710553f6cbfd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:57.913480 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844734961c2c4264b2d3710553f6cbfd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:57.914206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844734961c2c4264b2d3710553f6cbfd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:57.921795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844734961c2c4264b2d3710553f6cbfd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:57.929341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844734961c2c4264b2d3710553f6cbfd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:57.935378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1254/2475] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:57 2022] DELETE /identity/v3/users/844734961c2c4264b2d3710553f6cbfd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:57.942068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:57.942630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:57.942826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:57.963386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:24:57.964743 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:58.065063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1222/2476] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:24:58.072305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:58.073790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:58.147000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66deec19-2245-4abd-82ea-d49eb33cd95f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:58.158797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:58.159754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:58.160224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:58.163232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:58.175521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:58.177683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:58.191157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1255/2477] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:24:58.843159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:58.844972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:58.874697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd2ec1-0792-485d-92a6-d7be4e801939 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:58.885459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:58.886763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:58.886763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:58.886973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] PATH_INFO: `/v3/projects/ea62cd04ab55447db05e3f8e32a73e58` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:58.890769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea62cd04ab55447db05e3f8e32a73e58)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:58.892724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:58.955990 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea62cd04ab55447db05e3f8e32a73e58', 'request_id': 'req-61a2b718-a57c-453b-848d-7d532ea57996'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:58.962076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea62cd04ab55447db05e3f8e32a73e58', 'request_id': 'req-61a2b718-a57c-453b-848d-7d532ea57996'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:58.970434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea62cd04ab55447db05e3f8e32a73e58', 'request_id': 'req-61a2b718-a57c-453b-848d-7d532ea57996'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:58.982042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] The token cache is being invalidate because project ea62cd04ab55447db05e3f8e32a73e58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:58.982261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:58.983463 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:58.988503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1223/2478] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:58 2022] DELETE /identity/v3/projects/ea62cd04ab55447db05e3f8e32a73e58 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:58.990037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:59.001443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d16a0-4ab5-47b0-a149-4d8ddf1f1e1b service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:59.068769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:59.070112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:59.070617 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:59.071258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] PATH_INFO: `/v3/users/6650ab4af7394b4187cd5309b4a31ac5` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:59.072753 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6650ab4af7394b4187cd5309b4a31ac5)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:59.074961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:59.135755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6650ab4af7394b4187cd5309b4a31ac5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.150641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6650ab4af7394b4187cd5309b4a31ac5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.151755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6650ab4af7394b4187cd5309b4a31ac5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.160078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6650ab4af7394b4187cd5309b4a31ac5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.169484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6650ab4af7394b4187cd5309b4a31ac5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.181670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1256/2479] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:58 2022] DELETE /identity/v3/users/6650ab4af7394b4187cd5309b4a31ac5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:59.470934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:59.472774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:59.488209 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2b718-a57c-453b-848d-7d532ea57996 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:59.603326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:59.605415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:59.606167 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:59.609757 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] PATH_INFO: `/v3/projects/94b15e0995aa401aa24a96261d8d850e` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:59.612499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b15e0995aa401aa24a96261d8d850e)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:59.616650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:59.702627 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b15e0995aa401aa24a96261d8d850e', 'request_id': 'req-3f000088-8572-48c1-b1c9-2b77b0f78fa7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.721479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b15e0995aa401aa24a96261d8d850e', 'request_id': 'req-3f000088-8572-48c1-b1c9-2b77b0f78fa7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.739696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b15e0995aa401aa24a96261d8d850e', 'request_id': 'req-3f000088-8572-48c1-b1c9-2b77b0f78fa7'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.780398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] The token cache is being invalidate because project 94b15e0995aa401aa24a96261d8d850e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:24:59.785756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.787658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.790906 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1224/2480] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:24:59 2022] DELETE /identity/v3/projects/94b15e0995aa401aa24a96261d8d850e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:24:59.797117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:24:59.798632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:24:59.816298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052ae6a-1298-4e8f-a9ec-44b128b8aa79 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:24:59.889273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:24:59.890381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:24:59.890669 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:24:59.890942 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] PATH_INFO: `/v3/users/daad470ceb23433894a5c6ad8d8a4e11` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:24:59.892305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daad470ceb23433894a5c6ad8d8a4e11)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:24:59.894321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:24:59.954648 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daad470ceb23433894a5c6ad8d8a4e11'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.976100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daad470ceb23433894a5c6ad8d8a4e11'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.977092 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daad470ceb23433894a5c6ad8d8a4e11'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:24:59.990781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daad470ceb23433894a5c6ad8d8a4e11'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.003670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-de915f5c-6e07-4eb1-b741-211854111b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daad470ceb23433894a5c6ad8d8a4e11'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.011147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1257/2481] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:24:59 2022] DELETE /identity/v3/users/daad470ceb23433894a5c6ad8d8a4e11 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:25:00.346609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:00.348570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:00.366882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f000088-8572-48c1-b1c9-2b77b0f78fa7 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:00.440830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:00.442075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.442360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.442643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] PATH_INFO: `/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.444511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd6f32dd7ec40f68cee6f008fb6b2e1)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:00.446433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:00.508145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd6f32dd7ec40f68cee6f008fb6b2e1', 'request_id': 'req-e3538d43-1327-4812-ad35-c614c1e75cb3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.513624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd6f32dd7ec40f68cee6f008fb6b2e1', 'request_id': 'req-e3538d43-1327-4812-ad35-c614c1e75cb3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.524878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd6f32dd7ec40f68cee6f008fb6b2e1', 'request_id': 'req-e3538d43-1327-4812-ad35-c614c1e75cb3'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.545960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] The token cache is being invalidate because project 5cd6f32dd7ec40f68cee6f008fb6b2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:25:00.546380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.546921 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e3538d43-1327-4812-ad35-c614c1e75cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:00.552170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1225/2482] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:25:00 2022] DELETE /identity/v3/projects/5cd6f32dd7ec40f68cee6f008fb6b2e1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:25:00.553946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.554242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.554522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.592930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:00.592930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:00.716035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1258/2483] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:00.727923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.728231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.728493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.749773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:00.751096 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:00.759411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1226/2484] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:00.763638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:00.774144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca09270-3a45-46e6-ac6e-b02255647f7b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:00.778838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:00.779516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.779804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.780513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.780809 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:25:00.781154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:00.782757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:00.795407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1259/2485] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:25:00.799789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:00.809423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab23c45-1114-4862-b701-fefca8f3fbe3 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:00.816250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:00.816965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.817380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.817569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.818267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:00.820411 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:00.855434 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1227/2486] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:25:00 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:25:00.859473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:00.871438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd778840-eb7d-4b26-982d-40e2f93f51f8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:00.970694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:00.971442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:00.971791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:00.972137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:00.972947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:00.975002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:01.003344 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1260/2487] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:25:00 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:25:01.005766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:01.019416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07415f7-4a16-4e88-a279-a176bda72589 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:01.025590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:01.026559 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:01.027049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:01.027527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:01.028523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:01.030758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:01.062554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:01.063399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1228/2488] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:25:01.073954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2da857-f221-493c-978c-bab2944bb0de admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:01.079602 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:01.080356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:01.080720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:01.081102 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:01.081926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:01.083662 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1581594-b19c-4bd4-a679-f97c8a522bff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:01.096620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1261/2489] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:25:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:25:01.099044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:01.110003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d242e-4bee-44e0-9868-090365f4db19 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:01.115673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:01.116552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:01.116842 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:01.117158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] PATH_INFO: `/v3/projects/493b89776faf47c6bd695f73f3cdc601/users/0e66187f2b1a41f2834ba408cd209524/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:01.136404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] RBAC: Authorizing `identity:create_grant(project_id=493b89776faf47c6bd695f73f3cdc601, user_id=0e66187f2b1a41f2834ba408cd209524, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:01.140068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:01.174843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1229/2490] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:25:01 2022] PUT /identity/v3/projects/493b89776faf47c6bd695f73f3cdc601/users/0e66187f2b1a41f2834ba408cd209524/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:25:01.195811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:01.196357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:01.196874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:01.236889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] MFA Rules not processed for user `0e66187f2b1a41f2834ba408cd209524`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:01.238034 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:01.327736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1262/2491] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:25:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:01.340537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:01.342589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:01.428028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976290c-0047-4f7b-8703-b86ba336400d admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:01.433064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:01.433801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:01.434090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:01.434606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:01.446592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:01.448369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657582f-a0cb-4811-b576-943e98119afb service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:01.472873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1230/2492] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:25:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:25:14.952230 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:15.016069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5718d754-defe-486a-9562-e4454d16ec20 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:15.020539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:15.021434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:15.021717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:15.021984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] PATH_INFO: `/v3/users/0e66187f2b1a41f2834ba408cd209524` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:15.023194 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e66187f2b1a41f2834ba408cd209524)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:15.025223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:15.071277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e66187f2b1a41f2834ba408cd209524'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.082794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e66187f2b1a41f2834ba408cd209524'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.083462 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e66187f2b1a41f2834ba408cd209524'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.090137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e66187f2b1a41f2834ba408cd209524'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.098352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e66187f2b1a41f2834ba408cd209524'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.104356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1263/2493] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:25:14 2022] DELETE /identity/v3/users/0e66187f2b1a41f2834ba408cd209524 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:25:15.109487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:15.110044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:15.110044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:15.127759 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:15.129200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:15.189316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1231/2494] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:15.199315 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:15.200706 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:15.258358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b0a68-5e5a-4844-acfe-d08f762c2787 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:15.262039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:15.262687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:15.262970 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:15.263248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:15.273815 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:15.275260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:15.285848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1264/2495] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:25:15.558705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:15.560188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:15.578875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145524c-8040-4eb5-bfb3-dc0c290341f8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:15.584057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:15.585219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:15.585588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:15.585946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] PATH_INFO: `/v3/projects/493b89776faf47c6bd695f73f3cdc601` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:15.587640 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=493b89776faf47c6bd695f73f3cdc601)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:15.590016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:15.658162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '493b89776faf47c6bd695f73f3cdc601', 'request_id': 'req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.667846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '493b89776faf47c6bd695f73f3cdc601', 'request_id': 'req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.678865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '493b89776faf47c6bd695f73f3cdc601', 'request_id': 'req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.692439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] The token cache is being invalidate because project 493b89776faf47c6bd695f73f3cdc601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:25:15.692808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.693537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2ff6de09-83f7-4c40-9fdd-b8c2533b5c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:25:15.695308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1232/2496] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:25:15 2022] DELETE /identity/v3/projects/493b89776faf47c6bd695f73f3cdc601 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:25:16.157895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:16.159693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:16.255197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d0a7c-797a-4f54-a05a-ae2d7563dae8 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:16.336145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:16.336747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:16.337075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:16.337361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:16.339202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:16.352875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:16.355334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:16.375570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1265/2497] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:25:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:25:29.032316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c7e5-fba2-42c6-a8a6-fadb7f7f1d32 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:29.032869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c7e5-fba2-42c6-a8a6-fadb7f7f1d32 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:29.033083 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096c7e5-fba2-42c6-a8a6-fadb7f7f1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:29.051352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0096c7e5-fba2-42c6-a8a6-fadb7f7f1d32 None None] MFA Rules not processed for user `956bd79de25a40aca93e520cfaa296bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:29.052570 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0096c7e5-fba2-42c6-a8a6-fadb7f7f1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:29.118431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1233/2498] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:25:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:29.848442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:29.854165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:29.876806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eff45d-45d9-4219-911f-a1b90198d4c1 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:29.883024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:29.883730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:29.884010 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:29.884288 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:29.886219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:29.900513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:29.902286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:29.919091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1266/2499] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:25:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:25:32.370149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:32.370657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:32.370784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:32.390073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:25:32.391409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:32.447877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1234/2500] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:25:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:25:32.477534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:25:32.479615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:25:32.558057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb13fa4-c33c-435c-8942-2a683501a074 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:25:32.566741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:25:32.567413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:25:32.567710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:25:32.567969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:25:32.576969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:25:32.578612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:25:32.587991 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1267/2501] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:26:13.960147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:26:13.961756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:26:13.979366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5c9a7-a7b3-4502-a2b5-83605d6ebb76 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:26:13.985235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:26:13.986285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:26:13.986571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:26:13.986850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:26:13.988828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:26:14.053854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:26:14.055491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:26:14.067132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1235/2502] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:26:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:26:34.409777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:26:34.411989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:26:34.538672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b4bac-e309-4112-8e54-10121699991a service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:26:34.543784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:26:34.544667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:26:34.544993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:26:34.545269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] PATH_INFO: `/v3/users/956bd79de25a40aca93e520cfaa296bd` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:26:34.550065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956bd79de25a40aca93e520cfaa296bd)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:26:34.552172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:26:34.607135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956bd79de25a40aca93e520cfaa296bd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.621032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956bd79de25a40aca93e520cfaa296bd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.621800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956bd79de25a40aca93e520cfaa296bd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.630999 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956bd79de25a40aca93e520cfaa296bd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.639801 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-a7092767-0781-4a1f-82ef-0d87f30e1f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956bd79de25a40aca93e520cfaa296bd'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.647162 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1268/2503] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:26:34 2022] DELETE /identity/v3/users/956bd79de25a40aca93e520cfaa296bd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:26:34.839659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:26:34.852470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccad26e-3d72-4459-a8b8-e9550774c2dc service nova] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:26:34.923218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:26:34.924093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:26:34.924380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:26:34.924659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] PATH_INFO: `/v3/projects/1ba3b5e2169b40148cfb3daa6fb61162` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:26:34.925929 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba3b5e2169b40148cfb3daa6fb61162)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:26:34.927852 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:26:34.980229 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba3b5e2169b40148cfb3daa6fb61162', 'request_id': 'req-a0a88392-4aa4-4509-95af-1016b5c2d14f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.986462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba3b5e2169b40148cfb3daa6fb61162', 'request_id': 'req-a0a88392-4aa4-4509-95af-1016b5c2d14f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:34.994653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba3b5e2169b40148cfb3daa6fb61162', 'request_id': 'req-a0a88392-4aa4-4509-95af-1016b5c2d14f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:35.007582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] The token cache is being invalidate because project 1ba3b5e2169b40148cfb3daa6fb61162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:26:35.007881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:35.008684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:26:35.010345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1236/2504] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:26:34 2022] DELETE /identity/v3/projects/1ba3b5e2169b40148cfb3daa6fb61162 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:27:04.882634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ce97-817c-4cc1-9eff-fa29b2ab914f None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:27:04.883157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ce97-817c-4cc1-9eff-fa29b2ab914f None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:27:04.883278 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1ce97-817c-4cc1-9eff-fa29b2ab914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:27:04.902084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4bc1ce97-817c-4cc1-9eff-fa29b2ab914f None None] MFA Rules not processed for user `246b8f1d109749f3a8cf3da973aacaac`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:27:04.903457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4bc1ce97-817c-4cc1-9eff-fa29b2ab914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:27:04.967053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1269/2505] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:27:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:27:41.448928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:27:41.450522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:27:41.521561 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a88392-4aa4-4509-95af-1016b5c2d14f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:27:41.526600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db6749-8183-45bf-91e3-58654273affd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:27:41.527246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6749-8183-45bf-91e3-58654273affd service placement] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:27:41.527528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6749-8183-45bf-91e3-58654273affd service placement] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:27:41.527804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db6749-8183-45bf-91e3-58654273affd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:27:41.529575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-06db6749-8183-45bf-91e3-58654273affd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:27:41.541829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6749-8183-45bf-91e3-58654273affd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:27:41.543413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db6749-8183-45bf-91e3-58654273affd service placement] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:27:41.553730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1237/2506] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:27:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:27:44.228250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:27:44.228795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:27:44.228795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:27:44.246504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] MFA Rules not processed for user `6ae6b80b4cb946208c461caebad57faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:27:44.247691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:27:44.301919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1270/2507] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:27:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:03.083060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:03.083502 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:03.083717 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:03.101755 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:03.102948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:03.158175 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1238/2508] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:03.207342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:03.208756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:03.277969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa1d6d-18af-4a07-8021-eebc0ceeea7e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:03.283922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:03.284560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:03.284842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:03.285144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:03.293136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:03.294755 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:03.303735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1271/2509] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:28:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:28:03.642721 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:03.644143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:03.698087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a026a09-05cc-4631-a106-04ad5f5d3e49 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:03.701682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:03.702419 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:03.702706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:03.702984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:03.705393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:03.770222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:03.771664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:03.781191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1239/2510] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:28:10.540776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:10.542341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:10.559005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d71-237c-43cc-b11f-25589b4cef92 service swift] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:10.563580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:10.565171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:10.565474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:10.565750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] PATH_INFO: `/v3/users/94835c1fe2b64e06b994878d1143ed54` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:10.567144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=94835c1fe2b64e06b994878d1143ed54)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:10.569127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:10.617775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94835c1fe2b64e06b994878d1143ed54'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.629316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94835c1fe2b64e06b994878d1143ed54'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.629985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94835c1fe2b64e06b994878d1143ed54'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.637100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94835c1fe2b64e06b994878d1143ed54'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.645708 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94835c1fe2b64e06b994878d1143ed54'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.652023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1272/2511] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:28:10 2022] DELETE /identity/v3/users/94835c1fe2b64e06b994878d1143ed54 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:10.823988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:10.836864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca73a73-6039-40b6-b087-13ec934a46ee service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:10.893075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:10.893934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:10.894249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:10.894527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] PATH_INFO: `/v3/projects/b58d87f4f4ed448f8d45c85f92cf1462` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:10.895742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58d87f4f4ed448f8d45c85f92cf1462)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:10.897698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:10.942302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58d87f4f4ed448f8d45c85f92cf1462', 'request_id': 'req-7cd9562b-9e5a-402d-9471-29aed1d3584f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.947677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58d87f4f4ed448f8d45c85f92cf1462', 'request_id': 'req-7cd9562b-9e5a-402d-9471-29aed1d3584f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.955480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58d87f4f4ed448f8d45c85f92cf1462', 'request_id': 'req-7cd9562b-9e5a-402d-9471-29aed1d3584f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.966483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] The token cache is being invalidate because project b58d87f4f4ed448f8d45c85f92cf1462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:28:10.966770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.967497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:10.969090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1240/2512] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:28:10 2022] DELETE /identity/v3/projects/b58d87f4f4ed448f8d45c85f92cf1462 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:10.973934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:10.975779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:10.989322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5a9b0-a592-4f69-8694-9228feb5d5ea admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.052867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.053769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.054050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.054324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] PATH_INFO: `/v3/users/b512eeb2038b430981f2a4bb3ad3cdab` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.055528 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b512eeb2038b430981f2a4bb3ad3cdab)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.057490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.104798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b512eeb2038b430981f2a4bb3ad3cdab'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.121682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b512eeb2038b430981f2a4bb3ad3cdab'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.122622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b512eeb2038b430981f2a4bb3ad3cdab'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.129537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b512eeb2038b430981f2a4bb3ad3cdab'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.137196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-777a83c9-f485-4047-b902-06495052b789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b512eeb2038b430981f2a4bb3ad3cdab'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.144630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1273/2513] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:28:10 2022] DELETE /identity/v3/users/b512eeb2038b430981f2a4bb3ad3cdab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:11.321355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.322912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:11.342545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9562b-9e5a-402d-9471-29aed1d3584f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.406585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.407490 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.407879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.408159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] PATH_INFO: `/v3/projects/5c921988dc0e498399aeb62635a46c48` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.409421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c921988dc0e498399aeb62635a46c48)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.411344 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.462384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c921988dc0e498399aeb62635a46c48', 'request_id': 'req-5ceb426e-a154-434b-a903-32492e776a13'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.468845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c921988dc0e498399aeb62635a46c48', 'request_id': 'req-5ceb426e-a154-434b-a903-32492e776a13'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.481548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c921988dc0e498399aeb62635a46c48', 'request_id': 'req-5ceb426e-a154-434b-a903-32492e776a13'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.493776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] The token cache is being invalidate because project 5c921988dc0e498399aeb62635a46c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:28:11.494153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.494875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-5ceb426e-a154-434b-a903-32492e776a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:28:11.496481 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1241/2514] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:28:11 2022] DELETE /identity/v3/projects/5c921988dc0e498399aeb62635a46c48 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:11.502202 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.502490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.502761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.522626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:11.523852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:11.584358 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1274/2515] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:11.591960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.592253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.592531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.612155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:11.613589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:11.623262 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1242/2516] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:11.628363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.638472 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd138d24-0d09-4bb5-b775-3b5d07da23fc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.643225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.643877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.644161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.644438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.645219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:28:11.645583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.647511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.660402 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1275/2517] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:28:11.665126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.676150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4512c-eeb4-4e67-ba6b-8a11b52c0bbe None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.680769 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.681527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.681813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.682090 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.682795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.684720 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.722131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1243/2518] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:28:11 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:28:11.726172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.737538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fc18-6d1b-48f3-8959-7fd0ad2febcc admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.796715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.797408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.797688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.798486 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.799172 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.801097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.820435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1276/2519] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:28:11 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:28:11.824467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.834597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0bb1b-5d55-425f-b01d-ffaf1c87a460 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.839195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.839846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.840127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.840397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.841159 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.842731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.852258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1244/2520] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:28:11.856144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.867021 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831e4d-b688-4f10-8cbd-70e83d15dc96 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.871647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.872297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.872580 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.872857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.873624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.875197 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a50b-5c2e-43a4-976e-f1729f01c449 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.885608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1277/2521] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:28:11.889711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:11.899417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba59bce-1169-4113-94ab-844cfc678472 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:11.904006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:11.904877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.905189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.905464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] PATH_INFO: `/v3/projects/35abc0d9f3874ffd9bfc3e12d88497c8/users/38c585ad31ef4f50bd695bb379107a9a/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.920804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35abc0d9f3874ffd9bfc3e12d88497c8, user_id=38c585ad31ef4f50bd695bb379107a9a, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:11.924353 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:11.937102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1245/2522] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:28:11 2022] PUT /identity/v3/projects/35abc0d9f3874ffd9bfc3e12d88497c8/users/38c585ad31ef4f50bd695bb379107a9a/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:11.942322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b002aa-52d8-48e5-b3b0-9ea0a431f6cf None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:11.942610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b002aa-52d8-48e5-b3b0-9ea0a431f6cf None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:11.942910 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b002aa-52d8-48e5-b3b0-9ea0a431f6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:11.960299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-27b002aa-52d8-48e5-b3b0-9ea0a431f6cf None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:11.961408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-27b002aa-52d8-48e5-b3b0-9ea0a431f6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:12.020624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1278/2523] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:12.030352 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:12.032053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:12.087996 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc265c-8113-46b0-ab22-6e6ae4211c7f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:12.091689 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:12.092330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:12.092608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:12.093221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:12.102605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:12.104017 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:12.114176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1246/2524] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:28:16.317063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.317922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.318377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.368024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] MFA Rules not processed for user `38c585ad31ef4f50bd695bb379107a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:16.369570 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:16.439145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1279/2525] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:16.443417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.456818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41de823-c989-41e3-9af5-05a0eeca834b service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.461969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.462637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.462923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.463202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.463923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.465888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.496304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1247/2526] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:28:16 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:28:16.500316 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.512185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fa61a-500a-4f6a-8c66-f39558658271 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.571840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.572511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.572792 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.573105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.573824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.575743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.598682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1280/2527] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:28:16 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:28:16.602576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.617321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1664af-293a-49b0-90dd-6c000f2cef73 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.622356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.623101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.623452 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.623824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.625620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.627476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.638464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1248/2528] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:28:16.643167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.657025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04161873-d0dd-44c7-abfb-9b60dfa59ebe admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.663063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.663961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.664243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.664520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] PATH_INFO: `/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47/users/02ed78e195b04c1b9f3fae5eadf1fbf3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.681070 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b633b33a6da341e0b9ad7579d4fa0f47, user_id=02ed78e195b04c1b9f3fae5eadf1fbf3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.683739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.698978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1281/2529] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:28:16 2022] PUT /identity/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47/users/02ed78e195b04c1b9f3fae5eadf1fbf3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:28:16.702931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.714107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcc64-bf5b-4580-8a37-be4c6fc73582 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.773819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.774854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.775242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.775641 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.776472 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.778250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c42902-425c-407a-aa2f-b3f481993c87 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.788715 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1249/2530] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:28:16.793124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:16.804838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f59c9-cf00-4e70-80bf-a55375edec34 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:16.810554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:16.811828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:16.812109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:16.812385 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] PATH_INFO: `/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47/users/02ed78e195b04c1b9f3fae5eadf1fbf3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:16.815873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b633b33a6da341e0b9ad7579d4fa0f47, user_id=02ed78e195b04c1b9f3fae5eadf1fbf3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:16.818571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:16.830148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1282/2531] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:28:16 2022] PUT /identity/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47/users/02ed78e195b04c1b9f3fae5eadf1fbf3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:28:21.115241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bf120-9a2f-4695-82d2-dcc7fb895073 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:21.116091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bf120-9a2f-4695-82d2-dcc7fb895073 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:21.116379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bf120-9a2f-4695-82d2-dcc7fb895073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:21.144003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f13bf120-9a2f-4695-82d2-dcc7fb895073 None None] MFA Rules not processed for user `02ed78e195b04c1b9f3fae5eadf1fbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:21.145944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f13bf120-9a2f-4695-82d2-dcc7fb895073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:21.218870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1250/2532] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:21.230933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:21.232695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:21.309537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506a299-fb06-4f1d-8da5-3c3ce2847efd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:21.315178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:21.315847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:21.316132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:21.316406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:21.376483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:21.378395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e43549-35b1-49b6-be7e-8d010ef30115 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:21.397286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1283/2533] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:28:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:28:46.258002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:46.258610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:46.258839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:46.277309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] MFA Rules not processed for user `38c585ad31ef4f50bd695bb379107a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:46.278527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:46.285790 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1251/2534] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:28:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:59.272786 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:59.273332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:59.273436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:59.292295 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:28:59.293464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:59.349387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1284/2535] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:28:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:28:59.363637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:28:59.365093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:28:59.435443 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3229342-671f-47f8-bf31-8ff67f621bef None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:28:59.440739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:28:59.441382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:28:59.441667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:28:59.441943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:28:59.450860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:28:59.452535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:28:59.461055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1252/2536] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:28:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:06.212279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:06.213717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:06.273983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a541a-4a92-4d8b-86e5-8c306679e751 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:06.278424 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:06.279174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:06.279532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:06.279886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:06.291174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:06.292831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:06.304561 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1285/2537] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:08.330883 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:08.344584 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc4b12-cfb3-47d3-8bc9-0324bdc37222 service swift] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:08.352125 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:08.353180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:08.353673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:08.354112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:08.356091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:08.383911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:08.385593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361a6cf-8691-4d44-a2f6-317a032b69e7 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:08.399513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1253/2538] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:13.699435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:13.708369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa1043-135a-4599-84cd-f745ef770499 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:13.712235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:13.712866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:13.713183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:13.713461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:13.715268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:13.725781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:13.727264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e67c5-3b74-4c11-b29d-364b3cd4c8bb service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:13.736090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1286/2539] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:13.841664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:13.842250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:13.842250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:13.843955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1254/2540] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:29:13.851664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b439-0ce1-49ca-99ef-7fe8925a0c9c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:13.852186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b439-0ce1-49ca-99ef-7fe8925a0c9c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:13.852470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835b439-0ce1-49ca-99ef-7fe8925a0c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:13.870693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-d835b439-0ce1-49ca-99ef-7fe8925a0c9c None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:13.871886 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d835b439-0ce1-49ca-99ef-7fe8925a0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:13.881253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1287/2541] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:29:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:29:13.893925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:13.895659 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:13.959961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43185377-bb00-4baa-83ab-75a11a2f7a96 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:13.963815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a77604b8ff64cf883d700d2563ab131', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:13.964511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:13.964792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:13.965103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:13.976451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:13.977912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a8eb-c3a4-4e76-8ede-4b0b21588d35 service glance] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:13.989055 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1255/2542] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:14.054593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf26c-b4c0-4dc8-8855-7ab9a2962948 None None] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.054985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf26c-b4c0-4dc8-8855-7ab9a2962948 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.055326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cf26c-b4c0-4dc8-8855-7ab9a2962948 None None] PATH_INFO: `/` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.057200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1288/2543] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 15 04:29:14.062460 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52daeb-059b-4322-bad0-d74be793b64d None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.062774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52daeb-059b-4322-bad0-d74be793b64d None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.063074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52daeb-059b-4322-bad0-d74be793b64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.081940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-1f52daeb-059b-4322-bad0-d74be793b64d None None] MFA Rules not processed for user `f6dc0a5c1c714f0fb516cb1a6824ea83`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:14.083127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-1f52daeb-059b-4322-bad0-d74be793b64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:14.089639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1256/2544] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:29:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:29:14.101624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf26c-b4c0-4dc8-8855-7ab9a2962948 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:14.113997 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cf26c-b4c0-4dc8-8855-7ab9a2962948 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:14.117537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:14.118163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.118444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.118718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.126196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:14.127977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90e5a0-5c07-4c40-ba61-8c1027e540d8 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:14.135576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1289/2545] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:14.221408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698106-6c55-46c4-8124-fd4849a03859 None None] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.221698 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698106-6c55-46c4-8124-fd4849a03859 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.221979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698106-6c55-46c4-8124-fd4849a03859 None None] PATH_INFO: `/` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.223802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1257/2546] 10.222.0.45 () {54 vars in 921 bytes} [Tue Feb 15 04:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 15 04:29:14.229298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27469b-e659-4f92-96be-38180f1578cd None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.229587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27469b-e659-4f92-96be-38180f1578cd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.229863 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27469b-e659-4f92-96be-38180f1578cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.248384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7b27469b-e659-4f92-96be-38180f1578cd None None] MFA Rules not processed for user `f839e77bd3ad430d96b6957d398ec04a`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:14.249526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7b27469b-e659-4f92-96be-38180f1578cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:14.259453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1290/2547] 10.222.0.45 () {58 vars in 1018 bytes} [Tue Feb 15 04:29:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:14.270574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698106-6c55-46c4-8124-fd4849a03859 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:14.281605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698106-6c55-46c4-8124-fd4849a03859 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:14.285306 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:14.285973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:14.286257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:14.286533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:14.296692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:14.298218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:14.308515 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1258/2548] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:15.826678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931e39-01d0-41c9-b5d8-f18217d77337 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:15.827164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931e39-01d0-41c9-b5d8-f18217d77337 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:15.827258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931e39-01d0-41c9-b5d8-f18217d77337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:15.845370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-91931e39-01d0-41c9-b5d8-f18217d77337 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:15.846542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-91931e39-01d0-41c9-b5d8-f18217d77337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:15.853696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1291/2549] 10.222.0.45 () {58 vars in 1009 bytes} [Tue Feb 15 04:29:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:15.866447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:15.877900 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff24c6-32d0-4e77-88c3-abdaad955562 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:15.882809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa63d29-e945-457b-abf0-67794370187f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:15.883471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa63d29-e945-457b-abf0-67794370187f service swift] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:15.883754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa63d29-e945-457b-abf0-67794370187f service swift] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:15.884140 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa63d29-e945-457b-abf0-67794370187f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:15.892485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa63d29-e945-457b-abf0-67794370187f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:15.894173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa63d29-e945-457b-abf0-67794370187f service swift] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:15.901960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1259/2550] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:29:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:37.203600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:37.204105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:37.204200 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:37.225333 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] MFA Rules not processed for user `72749c07825e430e9ca092a0bead2bda`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:37.226817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:37.234937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1292/2551] 10.222.0.45 () {58 vars in 967 bytes} [Tue Feb 15 04:29:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:37.250530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa63d29-e945-457b-abf0-67794370187f service swift] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:37.261054 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa63d29-e945-457b-abf0-67794370187f service swift] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:37.266124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4d68bfed8d44a77a98bb887be0efd05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:37.266768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:37.267574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:37.267832 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:37.276357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:37.277953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:37.286939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1260/2552] 10.222.0.45 () {60 vars in 1384 bytes} [Tue Feb 15 04:29:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 15 04:29:38.708921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:38.718245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437060-7134-4917-91e3-217b5fcdd839 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:38.722067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:38.722757 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:38.723072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:38.723352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:38.725164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:38.739691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:38.741169 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:38.753356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1293/2553] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:43.220964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:43.229909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e3194-4d34-4d83-858d-5b79dd83b0bb service swift] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:43.233525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:43.234152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:43.234431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:43.234731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:43.237178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:43.297965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:43.300185 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:43.309571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1261/2554] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:46.583099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:46.584548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:46.599454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db82e0-83e4-480f-b6fb-a71d9e0cf3d1 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:46.604040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:46.605079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:46.605403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:46.605685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] PATH_INFO: `/v3/users/6ae6b80b4cb946208c461caebad57faa` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:46.621600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae6b80b4cb946208c461caebad57faa)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:46.623741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:46.672214 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae6b80b4cb946208c461caebad57faa'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:46.685401 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae6b80b4cb946208c461caebad57faa'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:46.686101 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae6b80b4cb946208c461caebad57faa'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:46.693951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae6b80b4cb946208c461caebad57faa'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:46.702291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-942dce0f-ec3f-44c1-98c7-d2015a33c96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae6b80b4cb946208c461caebad57faa'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:46.708923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1294/2555] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:29:46 2022] DELETE /identity/v3/users/6ae6b80b4cb946208c461caebad57faa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:29:46.878449 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:46.890631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6838d1b-6c20-482c-9575-412d34c4b3c1 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:46.948685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:46.949617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:46.949904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:46.950182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] PATH_INFO: `/v3/projects/e4ef5a0f7e5040c0aa3d33d31fbbb206` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:46.960341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ef5a0f7e5040c0aa3d33d31fbbb206)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:46.962287 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.007042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'request_id': 'req-8dbdbcd7-31c6-4310-899e-3f308624046a'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:47.012201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'request_id': 'req-8dbdbcd7-31c6-4310-899e-3f308624046a'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:47.019363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ef5a0f7e5040c0aa3d33d31fbbb206', 'request_id': 'req-8dbdbcd7-31c6-4310-899e-3f308624046a'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:47.031104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] The token cache is being invalidate because project e4ef5a0f7e5040c0aa3d33d31fbbb206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:29:47.031393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:47.032029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8dbdbcd7-31c6-4310-899e-3f308624046a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:47.034761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1262/2556] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:29:46 2022] DELETE /identity/v3/projects/e4ef5a0f7e5040c0aa3d33d31fbbb206 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:29:47.039752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.040042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.040324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.058141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:47.059327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.116490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1295/2557] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:47.124400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.124628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.124924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.143577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:47.144758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.152955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1263/2558] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:47.157795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.167629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99a8ce-bb96-4cd1-be26-1d946c246bf3 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.172255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.173562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.173976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.174255 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.174992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:29:47.175299 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.176917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.188093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1296/2559] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:29:47.192579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.201670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02a20-802d-42a0-8c63-4eee8a366f68 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.206433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.207074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.207360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.207638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.208328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.210269 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.237673 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1264/2560] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:29:47 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:29:47.241992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.251934 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7f5d-4dc4-49c1-ae2e-a6ac9b4e7969 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.307510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.308176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.308459 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.308736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.309494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.311454 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.330880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1297/2561] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:29:47 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:29:47.335108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.345879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb06d99-ccc3-49f7-ad1c-6bfbec8dff9a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.351934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.351934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.351934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.351934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.352610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.354174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.366768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1265/2562] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:29:47.370854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.381897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5c00a-4aae-41bb-8272-80ca30a33837 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.386660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.387320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.387607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.387887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.388630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.390262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d3683-eb27-4eb5-b80e-33a478683756 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.401260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1298/2563] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:29:47.405793 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.417021 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5dc5f-de46-4efe-aa8f-90aa5ff03f53 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.421681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.422583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.422864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.424292 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] PATH_INFO: `/v3/projects/df7379d48e5842c181126bb5b0a71574/users/76c57b4371c34cf290060b84d253ae5f/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.439215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7379d48e5842c181126bb5b0a71574, user_id=76c57b4371c34cf290060b84d253ae5f, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.442044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.454137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1266/2564] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:29:47 2022] PUT /identity/v3/projects/df7379d48e5842c181126bb5b0a71574/users/76c57b4371c34cf290060b84d253ae5f/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:29:47.464969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.465264 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.465545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.493274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] MFA Rules not processed for user `76c57b4371c34cf290060b84d253ae5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:47.494455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.557917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1299/2565] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:47.569109 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.570826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.640660 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07f5ec-3fbb-4aa7-85b4-3360f6224705 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.646747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.647395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.647676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.647953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.655628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.657244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.666417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1267/2566] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:47.686452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:47.687829 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.744861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235c651-6ffa-4ef0-afac-c2d33073c908 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:47.748546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:47.749226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:47.749504 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:47.749778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:47.751640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:47.765314 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:47.767306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d39f63-bc83-4840-b0f2-c2630896331d service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:47.778105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1300/2567] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:29:57.050060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:57.122600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b5ded-f8a0-4e45-a784-7915319844f0 service nova] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:57.128494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:57.129392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:57.129674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:57.129949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] PATH_INFO: `/v3/users/76c57b4371c34cf290060b84d253ae5f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:57.131152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c57b4371c34cf290060b84d253ae5f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:57.133723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:57.191626 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c57b4371c34cf290060b84d253ae5f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.192649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c57b4371c34cf290060b84d253ae5f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.205079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c57b4371c34cf290060b84d253ae5f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.212356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c57b4371c34cf290060b84d253ae5f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.213180 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c57b4371c34cf290060b84d253ae5f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.226367 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1268/2568] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:29:57 2022] DELETE /identity/v3/users/76c57b4371c34cf290060b84d253ae5f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:29:57.231012 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:57.231567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:57.231567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:57.249741 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:57.250965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:57.311916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1301/2569] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:57.322651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:57.324052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:57.399495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9a09-cb63-4e9b-b188-e3113dee60dd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:57.403504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:57.404158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:57.404439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:57.404713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:57.415146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:57.416700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73178791-2989-4d73-88ac-1849672f7b5e service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:57.426826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1269/2570] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:29:57.697044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:57.698514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:57.710240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5353f92-7fb6-4b16-ab6c-948c3b4e1c88 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:57.714880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:57.715725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:57.716000 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:57.716270 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] PATH_INFO: `/v3/projects/df7379d48e5842c181126bb5b0a71574` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:57.722329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7379d48e5842c181126bb5b0a71574)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:57.724158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:57.775971 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7379d48e5842c181126bb5b0a71574', 'request_id': 'req-0d9d6ad6-0942-43c8-99b6-12a84fa48545'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.781238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7379d48e5842c181126bb5b0a71574', 'request_id': 'req-0d9d6ad6-0942-43c8-99b6-12a84fa48545'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.789177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7379d48e5842c181126bb5b0a71574', 'request_id': 'req-0d9d6ad6-0942-43c8-99b6-12a84fa48545'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.800797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] The token cache is being invalidate because project df7379d48e5842c181126bb5b0a71574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:29:57.801132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.801828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0d9d6ad6-0942-43c8-99b6-12a84fa48545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:29:57.803349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1302/2571] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:29:57 2022] DELETE /identity/v3/projects/df7379d48e5842c181126bb5b0a71574 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:29:57.808237 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:57.808576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:57.808858 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:57.969325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:57.970557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:58.034495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1270/2572] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:58.043136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.043419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.043694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.063191 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:58.065111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:58.074061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1303/2573] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:58.078321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.087801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf38ea-bf51-4be5-9cb3-2b1deb059856 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.092325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.093006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.093289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.093562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.094325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:29:58.094625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.096245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.108844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1271/2574] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:29:58.113885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.123104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9630a1-bb4e-4713-ac69-ee2f8fbe38d9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.128440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.129118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.129413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.129678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.130422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.132293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.157606 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1304/2575] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:29:58 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:29:58.161973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.171498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4efb09-99c0-474b-89d3-3c7f0187c8cc admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.224124 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.224791 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.225112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.225392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.226091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.228032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.248468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1272/2576] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:29:58 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:29:58.253564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.263500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e5e7-c315-4095-9fa4-332d7467075c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.268404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.269090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.269370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.269641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.270366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.271945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.282178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1305/2577] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:29:58.286844 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.296384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b75b9c-3fde-4dfb-bff9-b29808d20648 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.301654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.302304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.302589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.302867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.303654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.305207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e097afe-61bf-472f-8ea2-9eca8248e07f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.315060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1273/2578] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:29:58.319097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.328795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a139e-9982-45c3-9ffc-68fbdf27d0b5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.333732 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.334597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.334902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.335178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] PATH_INFO: `/v3/projects/cb91e489c5a64091a2edb79e75b71faf/users/d2c6940e0b484e8385b01850a69dacfc/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.349931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb91e489c5a64091a2edb79e75b71faf, user_id=d2c6940e0b484e8385b01850a69dacfc, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.352614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.365803 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1306/2579] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:29:58 2022] PUT /identity/v3/projects/cb91e489c5a64091a2edb79e75b71faf/users/d2c6940e0b484e8385b01850a69dacfc/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:29:58.375937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.376258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.376537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.402761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] MFA Rules not processed for user `d2c6940e0b484e8385b01850a69dacfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:29:58.404011 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:58.469316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1274/2580] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:29:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:29:58.479711 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:29:58.481419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:29:58.536840 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0f9a-c5dd-43b6-aebb-190f491e2779 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:29:58.540566 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:29:58.541168 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:29:58.541449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:29:58.541734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:29:58.550799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:29:58.552223 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb9f7a-8e84-4957-87bb-428a9f049acb service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:29:58.561033 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1307/2581] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:29:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:06.743497 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:06.806384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3de33d-692f-4e98-927c-608fe046b348 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:06.810977 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:06.811837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:06.812120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:06.812393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] PATH_INFO: `/v3/users/d2c6940e0b484e8385b01850a69dacfc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:06.813605 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c6940e0b484e8385b01850a69dacfc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:06.816751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:06.863861 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c6940e0b484e8385b01850a69dacfc'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:06.864531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c6940e0b484e8385b01850a69dacfc'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:06.875819 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c6940e0b484e8385b01850a69dacfc'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:06.883316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c6940e0b484e8385b01850a69dacfc'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:06.884024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c6940e0b484e8385b01850a69dacfc'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:06.897917 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1275/2582] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:06 2022] DELETE /identity/v3/users/d2c6940e0b484e8385b01850a69dacfc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:06.902441 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:06.902984 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:06.903128 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:06.921103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:06.922300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:06.983292 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1308/2583] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:06.994310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:06.997395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:07.053203 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43e7a3-ae51-4ccf-867b-6cbd3ffbc352 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.057038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.057681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.057964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.058239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.067875 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.069333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd4dc4-11d0-4999-a056-47d52e65b618 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.078417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1276/2584] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:07.337453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.338874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:07.351396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709474d8-0f1b-4a1e-a66a-c215dbb41703 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.356104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.357032 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.357313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.357621 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] PATH_INFO: `/v3/projects/cb91e489c5a64091a2edb79e75b71faf` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.359558 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb91e489c5a64091a2edb79e75b71faf)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.361758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.409643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb91e489c5a64091a2edb79e75b71faf', 'request_id': 'req-fe88deb3-8055-4677-bf21-5908552cc9fe'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:07.414904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb91e489c5a64091a2edb79e75b71faf', 'request_id': 'req-fe88deb3-8055-4677-bf21-5908552cc9fe'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:07.422306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb91e489c5a64091a2edb79e75b71faf', 'request_id': 'req-fe88deb3-8055-4677-bf21-5908552cc9fe'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:07.433389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] The token cache is being invalidate because project cb91e489c5a64091a2edb79e75b71faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:07.433693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:07.434307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-fe88deb3-8055-4677-bf21-5908552cc9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:07.435824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1309/2585] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:07 2022] DELETE /identity/v3/projects/cb91e489c5a64091a2edb79e75b71faf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:30:07.441256 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.441545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.441824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.460548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:07.461788 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:07.519309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1277/2586] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:07.527120 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.527407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.527683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.546045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:07.547217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:07.555317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1310/2587] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:07.559805 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.569765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42a654-9d05-488d-a017-f9fc90d3c3f6 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.574354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.575001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.575280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.575552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.576279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:30:07.576580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.578189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.589938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1278/2588] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:30:07.594157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.603321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced631-72b1-49a5-9f16-e784f7e7e659 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.608076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.608715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.609031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.609308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.610031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.611994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.638057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1311/2589] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:07.642427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.653420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6dc201-ede1-4ada-b740-49ed7f0e4238 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.711247 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.711913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.712192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.712462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.713196 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.715078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.734642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1279/2590] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:07.739563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.749894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d431f05-e7b3-4649-b7ad-862f5972f44b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.755488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.756283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.756445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.756718 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.757491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.759081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.769820 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1312/2591] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:07.773893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.784094 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c676-5515-4550-ada6-e17acd768a52 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.789005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.789662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.789946 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.790222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.790958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.792574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a76d-a46c-4e54-94a5-41a2f346f2a8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.803225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1280/2592] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:07.807446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:07.819521 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290e72-a556-4e78-8e91-536c804d0c13 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:07.824198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:07.825099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.825377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.825646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] PATH_INFO: `/v3/projects/19015af560e64d208ea0fc7a30053304/users/8fd3bde49ca74749b34defbeea246e81/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.840221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19015af560e64d208ea0fc7a30053304, user_id=8fd3bde49ca74749b34defbeea246e81, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:07.842897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:07.856429 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1313/2593] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:07 2022] PUT /identity/v3/projects/19015af560e64d208ea0fc7a30053304/users/8fd3bde49ca74749b34defbeea246e81/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:30:07.868740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:07.869058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:07.869332 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:07.895851 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] MFA Rules not processed for user `8fd3bde49ca74749b34defbeea246e81`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:07.897119 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:07.958056 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1281/2594] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:07.970164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.032745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d815-6660-4484-89bd-c66f43584ecb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.038158 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.038883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.039163 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.039433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.040130 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.042052 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.068217 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1314/2595] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:30:08.072509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.083459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044e9a2-0f0a-4bfc-8a23-bf71223c453f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.137496 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.138153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.138433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.138704 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.139400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.141309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.161492 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1282/2596] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:08 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:08.165534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.176289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702fe7-23b4-4a6a-9236-3a27b74656a0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.180964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.181615 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.181898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.182174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.182900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.184485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.194686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1315/2597] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:30:08.198679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.208873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3b61-9d7b-4247-9b23-3368d9a8963a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.213671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.214573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.214854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.215128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] PATH_INFO: `/v3/projects/4370574e7bfd4566a26a9e370b94761a/users/009298e912c94a19bbcdcf9e313093b8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.229932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4370574e7bfd4566a26a9e370b94761a, user_id=009298e912c94a19bbcdcf9e313093b8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.232547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.245766 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1283/2598] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:08 2022] PUT /identity/v3/projects/4370574e7bfd4566a26a9e370b94761a/users/009298e912c94a19bbcdcf9e313093b8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:08.249958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.259838 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c2c7c-a529-47ff-9787-aa4b7f8a1928 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.314434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.315087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.315370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.315677 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.316410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.318080 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26dd3f-7995-4bad-a171-d2e625c77ce4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.327683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1316/2599] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:30:08.331814 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.341955 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0b7f1-d92a-4ef7-b471-39940adf1686 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.347244 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.348116 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.348399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.348675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] PATH_INFO: `/v3/projects/4370574e7bfd4566a26a9e370b94761a/users/009298e912c94a19bbcdcf9e313093b8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.350666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4370574e7bfd4566a26a9e370b94761a, user_id=009298e912c94a19bbcdcf9e313093b8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.353392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.364446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1284/2600] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:08 2022] PUT /identity/v3/projects/4370574e7bfd4566a26a9e370b94761a/users/009298e912c94a19bbcdcf9e313093b8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:30:08.374327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.374622 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.374902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.402119 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] MFA Rules not processed for user `009298e912c94a19bbcdcf9e313093b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:08.403491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:08.470604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1317/2601] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:08.481268 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.482960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:08.540323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124cdfd-a4a2-4671-9be6-4accf0e55d0b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.543947 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.544618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.544923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.545201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.555980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.557732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.567644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1285/2602] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:08.636712 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:08.647500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3201b-a011-4f86-a9df-42269f5bda89 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:08.651410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:08.652041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:08.652321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:08.652591 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:08.708938 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:08.710844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:08.719837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1318/2603] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:47.418571 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:47.420036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:47.475465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22366be-e4bb-4843-a062-14893a7f7ad0 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:47.479102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:47.479741 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:47.480033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:47.480313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:47.482273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:47.492298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:47.493820 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:47.501527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1286/2604] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:47.982039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:47.983353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:47.995698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc268f-c36b-4d15-aadf-86a2a87fd678 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:48.000241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:48.001142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:48.001500 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:48.001879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:48.004678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:48.095338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:48.096642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:48.122025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1319/2605] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:50.829022 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:50.904836 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:50.906935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:50.912860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6c62-7b77-4a47-a72f-d2c3f0620951 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:50.934408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:50.935916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:50.936207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:50.936499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] PATH_INFO: `/v3/users/8fd3bde49ca74749b34defbeea246e81` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:50.938002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd3bde49ca74749b34defbeea246e81)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:50.940131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:51.023463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88e529-4105-4c3e-9275-c83a3df37bae service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:51.033111 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd3bde49ca74749b34defbeea246e81'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.033860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd3bde49ca74749b34defbeea246e81'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.038802 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:51.040563 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:51.041136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:51.041661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:51.044389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:51.053725 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd3bde49ca74749b34defbeea246e81'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.059318 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:51.061335 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb32d7-1729-4013-ac64-c1b7a29935cc service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:51.070169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd3bde49ca74749b34defbeea246e81'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.070908 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd3bde49ca74749b34defbeea246e81'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.076247 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1320/2606] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:51.086044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1287/2607] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:50 2022] DELETE /identity/v3/users/8fd3bde49ca74749b34defbeea246e81 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:51.091009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:51.091380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:51.091661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:51.111396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:51.112919 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:51.184091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1321/2608] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:51.193746 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:51.195391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:51.253312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a324cc-5222-433b-96d8-f09b34452e54 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:51.256951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:51.257604 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:51.257891 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:51.258171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:51.267635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:51.269270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:51.278675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1288/2609] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:51.571901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:51.573649 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:51.586354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d7d95-2d72-4137-a779-f8886f54a12d None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:51.592304 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:51.593512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:51.593917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:51.594294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] PATH_INFO: `/v3/projects/19015af560e64d208ea0fc7a30053304` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:51.595727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19015af560e64d208ea0fc7a30053304)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:51.597875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:51.650129 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19015af560e64d208ea0fc7a30053304', 'request_id': 'req-5643690b-bcec-4904-bd49-95dcd7dd42d7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.655770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19015af560e64d208ea0fc7a30053304', 'request_id': 'req-5643690b-bcec-4904-bd49-95dcd7dd42d7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.663958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19015af560e64d208ea0fc7a30053304', 'request_id': 'req-5643690b-bcec-4904-bd49-95dcd7dd42d7'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.677198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] The token cache is being invalidate because project 19015af560e64d208ea0fc7a30053304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:51.677399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.678044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.679590 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1322/2610] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:51 2022] DELETE /identity/v3/projects/19015af560e64d208ea0fc7a30053304 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:51.684409 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:51.694221 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935560b-f0fe-4daf-b878-464f073bb700 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:51.756444 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:51.757361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:51.757642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:51.757918 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] PATH_INFO: `/v3/users/009298e912c94a19bbcdcf9e313093b8` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:51.759739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009298e912c94a19bbcdcf9e313093b8)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:51.761722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:51.819575 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009298e912c94a19bbcdcf9e313093b8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.821988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009298e912c94a19bbcdcf9e313093b8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.840924 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009298e912c94a19bbcdcf9e313093b8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.847966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009298e912c94a19bbcdcf9e313093b8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.848574 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-7b11fb57-5998-4b4a-bcfd-e01088290904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009298e912c94a19bbcdcf9e313093b8'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:51.863963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1289/2611] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:51 2022] DELETE /identity/v3/users/009298e912c94a19bbcdcf9e313093b8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:52.366062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.367817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:52.382342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643690b-bcec-4904-bd49-95dcd7dd42d7 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.441213 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.442007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.442357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.442550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] PATH_INFO: `/v3/projects/4370574e7bfd4566a26a9e370b94761a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.443841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4370574e7bfd4566a26a9e370b94761a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.445937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.496185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4370574e7bfd4566a26a9e370b94761a', 'request_id': 'req-848ff736-6e86-4c7d-a815-5429eb4795ed'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:52.502736 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4370574e7bfd4566a26a9e370b94761a', 'request_id': 'req-848ff736-6e86-4c7d-a815-5429eb4795ed'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:52.510895 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4370574e7bfd4566a26a9e370b94761a', 'request_id': 'req-848ff736-6e86-4c7d-a815-5429eb4795ed'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:52.523600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] The token cache is being invalidate because project 4370574e7bfd4566a26a9e370b94761a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:52.523891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:52.524587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-848ff736-6e86-4c7d-a815-5429eb4795ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:52.526155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1323/2612] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:52 2022] DELETE /identity/v3/projects/4370574e7bfd4566a26a9e370b94761a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:52.531034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.531323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.531607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.551879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:52.553149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:52.614218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1290/2613] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:52.622105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.622398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.622814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.644242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:52.645588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:52.654800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1324/2614] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:30:52.660648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.671364 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42594-53cd-440f-ad7d-56c7d57d14f0 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.676042 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.676696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.677013 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.677288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.678016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:30:52.678319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.680001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.692381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1291/2615] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:30:52.697619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.707724 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a99c1-2259-41ce-a17f-ef6440d11794 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.713260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.714041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.714291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.714839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.715626 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.717764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.748939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1325/2616] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:52 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:52.752358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.762796 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24877e03-2d76-4afc-9674-9d3a247b4a7c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.818862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.819708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.820231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.820583 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.822567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.825315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.846685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1292/2617] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:52 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:52.850955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.861136 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b05f5b-a8e1-43ca-ac50-4bc951f916f3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.866342 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.866994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.867277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.867551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.869039 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.870633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.881006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1326/2618] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:52.885911 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.896414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da9a-8906-469a-98fe-e5ec214412e2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.903069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.904396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.905146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.905146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.906145 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.907829 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6b463-5c71-46b5-a160-f91b97f11dcb admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.919580 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1293/2619] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:52.923923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:52.934680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e338-f71a-4b23-a110-91d4706bd0e5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:52.939495 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:52.940365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.940644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.940947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] PATH_INFO: `/v3/projects/4bdcb6bfe70747f49c7f912182aa81ec/users/05cec13d9cdb44b394e90cd320738d73/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:52.955884 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bdcb6bfe70747f49c7f912182aa81ec, user_id=05cec13d9cdb44b394e90cd320738d73, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:52.958502 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:52.971277 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1327/2620] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:52 2022] PUT /identity/v3/projects/4bdcb6bfe70747f49c7f912182aa81ec/users/05cec13d9cdb44b394e90cd320738d73/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:52.981960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:52.982250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:52.982533 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.010295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] MFA Rules not processed for user `05cec13d9cdb44b394e90cd320738d73`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:53.011488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:53.073117 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1294/2621] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:53.077652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.137623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517438cc-2522-4b64-8134-97a51ee8300f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.142305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.142956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.143258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.143518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.144210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.146167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.170807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1328/2622] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:53 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:53.174881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.186046 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fbb06-ae8d-41cf-9040-68646616dc20 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.241051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.241624 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.241909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.242189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.243387 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.245336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.265101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1295/2623] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:53 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:53.269100 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.279511 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30255157-90ee-46b0-be6d-514ee69eae1e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.284116 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.284818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.285205 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.285531 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.286261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.287839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.299145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1329/2624] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:53.303218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.314224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c53285-ad9e-4715-8ee8-7a5ba2932174 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.318783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.319647 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.319928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.320201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] PATH_INFO: `/v3/projects/58ecad00a32c461a9c38d10d7091ae5f/users/f3c0b8a6f14e403abb795cffe4051127/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.335368 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ecad00a32c461a9c38d10d7091ae5f, user_id=f3c0b8a6f14e403abb795cffe4051127, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.339467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.352105 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1296/2625] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:53 2022] PUT /identity/v3/projects/58ecad00a32c461a9c38d10d7091ae5f/users/f3c0b8a6f14e403abb795cffe4051127/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:53.356568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.366605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac983a87-4ebc-4f08-9e70-15b250750458 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.421723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.422460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.422743 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.423020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.423764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.425456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92444b-f22f-4be9-8366-a5aa476c1278 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.435913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1330/2626] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:53.440005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.450576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f8ef2-9d15-4f7a-9d26-21e100bc7a11 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.455239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.456108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.456390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.456662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] PATH_INFO: `/v3/projects/58ecad00a32c461a9c38d10d7091ae5f/users/f3c0b8a6f14e403abb795cffe4051127/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.458645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ecad00a32c461a9c38d10d7091ae5f, user_id=f3c0b8a6f14e403abb795cffe4051127, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.461285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.471362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1297/2627] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:53 2022] PUT /identity/v3/projects/58ecad00a32c461a9c38d10d7091ae5f/users/f3c0b8a6f14e403abb795cffe4051127/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:53.483176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.483469 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.483747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.510523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] MFA Rules not processed for user `f3c0b8a6f14e403abb795cffe4051127`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:53.511646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:53.576683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1331/2628] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:53.586890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.588672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:53.644478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4bb05-1593-4708-9b4c-f94bfb594cb6 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.648061 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.648694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.649003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.649853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.658813 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.660224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9417-2f66-4a9c-8e55-1d05860a5de3 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.670548 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1298/2629] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:53.846748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:53.914073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fa815-c05a-469b-a89d-677bf04d12f7 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:53.921237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:53.921237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:53.921237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:53.921237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] PATH_INFO: `/v3/users/05cec13d9cdb44b394e90cd320738d73` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:53.922069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05cec13d9cdb44b394e90cd320738d73)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:53.924073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:53.972850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cec13d9cdb44b394e90cd320738d73'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:53.984465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cec13d9cdb44b394e90cd320738d73'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:53.985171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cec13d9cdb44b394e90cd320738d73'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:53.992006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cec13d9cdb44b394e90cd320738d73'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:53.999988 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cec13d9cdb44b394e90cd320738d73'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.006037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1332/2630] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:53 2022] DELETE /identity/v3/users/05cec13d9cdb44b394e90cd320738d73 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:54.011740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:54.012404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:54.012404 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:54.030348 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:54.031448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:54.088477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1299/2631] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:54.098125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:54.099595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:54.157852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5cf27c-0304-4832-b949-d1a81dcc25c0 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:54.161918 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:54.162582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:54.162869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:54.163148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:54.175683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:54.177195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:54.188926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1333/2632] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:54.450426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:54.451872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:54.464024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9029f-6e17-4807-98aa-ba31a3e090f8 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:54.468658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:54.469547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:54.469830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:54.470100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] PATH_INFO: `/v3/projects/4bdcb6bfe70747f49c7f912182aa81ec` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:54.471301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bdcb6bfe70747f49c7f912182aa81ec)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:54.473254 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:54.525552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bdcb6bfe70747f49c7f912182aa81ec', 'request_id': 'req-a3a346d9-caaf-44f3-86a8-26f4090c3834'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.530763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bdcb6bfe70747f49c7f912182aa81ec', 'request_id': 'req-a3a346d9-caaf-44f3-86a8-26f4090c3834'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.541537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bdcb6bfe70747f49c7f912182aa81ec', 'request_id': 'req-a3a346d9-caaf-44f3-86a8-26f4090c3834'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.552403 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] The token cache is being invalidate because project 4bdcb6bfe70747f49c7f912182aa81ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:54.552693 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.553359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.554907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1300/2633] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:54 2022] DELETE /identity/v3/projects/4bdcb6bfe70747f49c7f912182aa81ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:54.559157 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:54.568430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0bfd5-33ef-45a2-ab18-e2272ea182fa service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:54.624491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:54.625415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:54.625698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:54.625990 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] PATH_INFO: `/v3/users/f3c0b8a6f14e403abb795cffe4051127` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:54.627176 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c0b8a6f14e403abb795cffe4051127)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:54.629143 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:54.678155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c0b8a6f14e403abb795cffe4051127'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.689289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c0b8a6f14e403abb795cffe4051127'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.689964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c0b8a6f14e403abb795cffe4051127'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.696398 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c0b8a6f14e403abb795cffe4051127'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.703510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c0b8a6f14e403abb795cffe4051127'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:54.709683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1334/2634] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:54 2022] DELETE /identity/v3/users/f3c0b8a6f14e403abb795cffe4051127 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:54.982988 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:54.984489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:54.999121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a346d9-caaf-44f3-86a8-26f4090c3834 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.059058 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.059849 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.060130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.060401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] PATH_INFO: `/v3/projects/58ecad00a32c461a9c38d10d7091ae5f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.061620 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ecad00a32c461a9c38d10d7091ae5f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.064334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.073268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.074846 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:55.111677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ecad00a32c461a9c38d10d7091ae5f', 'request_id': 'req-db008158-3c73-4916-a43e-3c2c21f885da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:55.117322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ecad00a32c461a9c38d10d7091ae5f', 'request_id': 'req-db008158-3c73-4916-a43e-3c2c21f885da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:55.126357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ecad00a32c461a9c38d10d7091ae5f', 'request_id': 'req-db008158-3c73-4916-a43e-3c2c21f885da'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:55.133148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90197031-9cc2-4991-8709-9527ba14726c admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.139797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] The token cache is being invalidate because project 58ecad00a32c461a9c38d10d7091ae5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:55.140232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:55.140885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-db008158-3c73-4916-a43e-3c2c21f885da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:55.142433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1301/2635] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:54 2022] DELETE /identity/v3/projects/58ecad00a32c461a9c38d10d7091ae5f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:55.147265 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381f7d-3032-4ad3-adb8-4dda8f9c92e2 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.147545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381f7d-3032-4ad3-adb8-4dda8f9c92e2 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.147817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57381f7d-3032-4ad3-adb8-4dda8f9c92e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.167346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-57381f7d-3032-4ad3-adb8-4dda8f9c92e2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:55.168586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-57381f7d-3032-4ad3-adb8-4dda8f9c92e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:55.188117 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.188874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.189199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.189475 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.191370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:55.226710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1302/2636] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:30:55.234371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.234656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.234926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.253512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:55.254685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:55.254807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.256263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.263458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1303/2637] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:30:55.266688 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1335/2638] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:30:55.267531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.276789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e025cbd-89cf-432d-b07a-213dc571a5ac None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.281427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.282080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.282363 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.282635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.283365 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:30:55.283663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.285261 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.297263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1304/2639] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:30:55.301667 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.312177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c703d-66b7-4c61-a90a-4f0cb7056ddd service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.316870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.317545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.317828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.318103 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.318807 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.320806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.350761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1336/2640] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:55.351912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.362925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60320c0e-0879-4cac-a5a9-39c06b57d912 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.420319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.421158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.421445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.421749 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.422465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.424379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.445665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1305/2641] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:30:55.449907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.459982 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7922-f790-4281-a898-2471fff4a378 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.465946 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.466611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.466917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.467198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.467939 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.469573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.480933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1337/2642] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:30:55.485024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.495146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c39c11-e109-4520-9982-68a9c01ce3e1 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.499865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.500520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.500807 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.501112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.501888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.503544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e9df6-096e-46bb-8348-0fd7ef3ec977 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.515488 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1306/2643] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:55.518652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.529746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95399d2c-5703-4b65-83a8-bcbc4c434f0f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.534795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.535847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.536290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.536567 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] PATH_INFO: `/v3/projects/26fda6c29360479fa0cac3c6c939465b/users/341eb88a25444ff381a9a5f064cbea33/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.552355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fda6c29360479fa0cac3c6c939465b, user_id=341eb88a25444ff381a9a5f064cbea33, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.555022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.568933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1338/2644] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:55 2022] PUT /identity/v3/projects/26fda6c29360479fa0cac3c6c939465b/users/341eb88a25444ff381a9a5f064cbea33/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:55.579316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.579608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.579890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.608719 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] MFA Rules not processed for user `341eb88a25444ff381a9a5f064cbea33`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:55.610202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:55.674578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1307/2645] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:55.679067 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.741513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171d90c-4c06-46b2-8245-473a76705d99 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.752011 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.753137 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.753549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.753921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.754739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.756661 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.786562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1339/2646] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:55.787733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.799478 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c93b6b-ff2a-483d-b534-f6d5a2a74b12 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.857753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.858333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.858615 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.858916 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.859628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.861573 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.885044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1308/2647] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:55 2022] POST /identity/v3/users => generated 307 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:30:55.887473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.897914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea6eb1-24a1-4ef6-8cc0-cbe01a2880ab admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.904313 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.904866 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.905323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.905657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.906685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.908284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.920211 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1340/2648] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:55.924413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.935210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9d9a9-5033-43d2-8160-2b69c49e70a2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:55.940048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:55.941080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:55.941394 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:55.941675 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] PATH_INFO: `/v3/projects/2a5dbc3ef855423887e07f76aa03c10c/users/f0246db7320a4f1e97caadc43c3bac49/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:55.957441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5dbc3ef855423887e07f76aa03c10c, user_id=f0246db7320a4f1e97caadc43c3bac49, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:55.960099 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:55.974417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1309/2649] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:55 2022] PUT /identity/v3/projects/2a5dbc3ef855423887e07f76aa03c10c/users/f0246db7320a4f1e97caadc43c3bac49/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:30:55.979056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:55.989434 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47662d36-c9d0-41d6-9c40-cb0af0818581 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:56.047369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:56.048048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:56.048357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:56.048633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:56.049425 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:56.051053 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2260ba62-4116-4f82-9a7f-7de851052d88 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:56.062593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1341/2650] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:56.066550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:56.077395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af83b28-fd02-4a8d-8f3f-430dad2f3b78 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:56.082049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:56.082922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:56.083201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:56.083476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] PATH_INFO: `/v3/projects/2a5dbc3ef855423887e07f76aa03c10c/users/f0246db7320a4f1e97caadc43c3bac49/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:56.085664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5dbc3ef855423887e07f76aa03c10c, user_id=f0246db7320a4f1e97caadc43c3bac49, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:56.088471 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:56.098991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1310/2651] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:56 2022] PUT /identity/v3/projects/2a5dbc3ef855423887e07f76aa03c10c/users/f0246db7320a4f1e97caadc43c3bac49/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:56.110361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:56.110572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:56.110849 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:56.140023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] MFA Rules not processed for user `f0246db7320a4f1e97caadc43c3bac49`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:56.141254 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:56.212455 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1342/2652] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:56.222512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:56.225308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:56.297804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713246-7391-450d-a3ec-7113cb09abe3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:56.302063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:56.302794 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:56.303144 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:56.303512 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:56.314780 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:56.316326 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:56.327360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1311/2653] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:56.412466 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:56.423542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0abd23e-0e8b-46a5-b30a-c7ee60f5ad81 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:56.427286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:56.427922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:56.428201 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:56.428471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:56.487008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:56.488663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:56.498306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1343/2654] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:30:58.714545 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:58.716066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:58.781501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2491e2-6b73-4d6d-95a2-afe0a8cb2429 service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:58.786007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:58.786877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:58.787157 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:58.787430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] PATH_INFO: `/v3/users/246b8f1d109749f3a8cf3da973aacaac` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:58.788668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] RBAC: Authorizing `identity:delete_user(user_id=246b8f1d109749f3a8cf3da973aacaac)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:58.790784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:58.835550 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246b8f1d109749f3a8cf3da973aacaac'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:58.836208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246b8f1d109749f3a8cf3da973aacaac'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:58.848015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246b8f1d109749f3a8cf3da973aacaac'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:58.854586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246b8f1d109749f3a8cf3da973aacaac'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:58.855246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-88d612d0-189a-434a-a4ab-8f6611fb928a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246b8f1d109749f3a8cf3da973aacaac'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:58.867696 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1312/2655] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:30:58 2022] DELETE /identity/v3/users/246b8f1d109749f3a8cf3da973aacaac => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:59.037196 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.048297 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09480ef-edf3-4aa0-9ac6-f506dc21e282 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.105089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.105950 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.106237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.106518 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] PATH_INFO: `/v3/projects/b6908f5f033f4c8888210c0cf405f4fa` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.107874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6908f5f033f4c8888210c0cf405f4fa)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.109841 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.157014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6908f5f033f4c8888210c0cf405f4fa', 'request_id': 'req-74f06258-596d-427f-9b0f-3a2f7222dcbf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:59.163007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6908f5f033f4c8888210c0cf405f4fa', 'request_id': 'req-74f06258-596d-427f-9b0f-3a2f7222dcbf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:59.171365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6908f5f033f4c8888210c0cf405f4fa', 'request_id': 'req-74f06258-596d-427f-9b0f-3a2f7222dcbf'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:59.183759 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] The token cache is being invalidate because project b6908f5f033f4c8888210c0cf405f4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:30:59.184106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:59.184682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-74f06258-596d-427f-9b0f-3a2f7222dcbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:30:59.186221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1344/2656] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:30:59 2022] DELETE /identity/v3/projects/b6908f5f033f4c8888210c0cf405f4fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:59.191329 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.191642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.191923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.212289 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:59.213383 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:59.273231 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1313/2657] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:59.280758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.281078 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.281355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.300381 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:59.301552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:59.309810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1345/2658] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:59.313980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.324174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef32db-8778-4ddc-9699-35ae0205f6ae None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.328758 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.329467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.329750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.330028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.330764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:30:59.331068 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.332727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.345860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1314/2659] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:30:59.350115 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.359897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519ee0b-d31f-4b2e-9304-a841f0efe350 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.364960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.365612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.365891 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.366178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.366893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.369361 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.398808 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1346/2660] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:30:59.403476 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.413784 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095d5a6-c3a8-40dd-9db5-d76cc9c07695 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.469005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.469674 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.469961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.470242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.470935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.472835 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.492619 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1315/2661] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:30:59 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:30:59.496872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.507243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bcf34-3b3f-4cf9-94de-298a7fefda2f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.513858 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.514530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.514813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.515089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.515835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.517463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.529226 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1347/2662] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:30:59.533288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.544072 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e395d0-4868-4e8c-bb27-85ab453a1470 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.549069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.549732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.550018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.550296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.551147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.552737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea910af-2c95-44f6-a758-dd9667549f3c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.567388 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1316/2663] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:30:59.568794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.582837 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b473965-49ad-4189-a4f0-7633f4114966 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.589793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.590709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.590987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.591291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] PATH_INFO: `/v3/projects/78efdf2848b04b2680d4333cf1534031/users/c2af4c9e7a6f4f04a5b25b013a92d2a9/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.607443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=78efdf2848b04b2680d4333cf1534031, user_id=c2af4c9e7a6f4f04a5b25b013a92d2a9, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.610233 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.626739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1348/2664] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:30:59 2022] PUT /identity/v3/projects/78efdf2848b04b2680d4333cf1534031/users/c2af4c9e7a6f4f04a5b25b013a92d2a9/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:30:59.638623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.638912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.639188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.665697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] MFA Rules not processed for user `c2af4c9e7a6f4f04a5b25b013a92d2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:30:59.666922 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:59.730270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1317/2665] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:30:59.741373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:30:59.743969 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:30:59.816975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012cb21-1939-414e-992c-a312b36fd94f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:30:59.824583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:30:59.825271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:30:59.825557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:30:59.825835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:30:59.833835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:30:59.835422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540edd71-e089-4afe-9808-ba4f4a1140a3 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:30:59.844287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1349/2666] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:30:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:00.019811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.080776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfb7bc-2e64-4e0e-84bb-155a79cf734e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.085176 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.086038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.086316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.086586 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] PATH_INFO: `/v3/users/c2af4c9e7a6f4f04a5b25b013a92d2a9` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.088028 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2af4c9e7a6f4f04a5b25b013a92d2a9)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.090005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.137789 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2af4c9e7a6f4f04a5b25b013a92d2a9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.138483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2af4c9e7a6f4f04a5b25b013a92d2a9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.149982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2af4c9e7a6f4f04a5b25b013a92d2a9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.156672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2af4c9e7a6f4f04a5b25b013a92d2a9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.157376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2af4c9e7a6f4f04a5b25b013a92d2a9'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.170614 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1318/2667] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:00 2022] DELETE /identity/v3/users/c2af4c9e7a6f4f04a5b25b013a92d2a9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:00.180380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.180992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.180992 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.199365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:00.200828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.260850 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1350/2668] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:00.272372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.273804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.329945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862971f-f714-4f70-ac5b-1eb0db1ecab3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.333663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.334238 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.334525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.334799 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.344494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.345970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.355894 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1319/2669] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:00.596922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.598370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.611955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c716282-0427-4962-a17e-50e014f17bc9 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.617623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.618778 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.619236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.619701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] PATH_INFO: `/v3/users/341eb88a25444ff381a9a5f064cbea33` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.620967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=341eb88a25444ff381a9a5f064cbea33)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.623243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.634372 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.636692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.650617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab5fb-ba38-4a3e-92fd-cbe6b2a86c8e service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.656616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.657520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.657877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.658219 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] PATH_INFO: `/v3/projects/78efdf2848b04b2680d4333cf1534031` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.659572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78efdf2848b04b2680d4333cf1534031)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.661893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.680540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341eb88a25444ff381a9a5f064cbea33'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.693505 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341eb88a25444ff381a9a5f064cbea33'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.694346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341eb88a25444ff381a9a5f064cbea33'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.701898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341eb88a25444ff381a9a5f064cbea33'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.709857 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-29944f5c-4d63-4264-8ac0-d9152ca1b1ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341eb88a25444ff381a9a5f064cbea33'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.721031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1351/2670] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:00 2022] DELETE /identity/v3/users/341eb88a25444ff381a9a5f064cbea33 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:00.722050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.722458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78efdf2848b04b2680d4333cf1534031', 'request_id': 'req-acf40258-2955-4dbf-bcbb-08e9f1a17d21'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.722572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.722779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.729234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78efdf2848b04b2680d4333cf1534031', 'request_id': 'req-acf40258-2955-4dbf-bcbb-08e9f1a17d21'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.737424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78efdf2848b04b2680d4333cf1534031', 'request_id': 'req-acf40258-2955-4dbf-bcbb-08e9f1a17d21'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.742450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:00.743697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.751354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] The token cache is being invalidate because project 78efdf2848b04b2680d4333cf1534031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:00.751354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.751354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-acf40258-2955-4dbf-bcbb-08e9f1a17d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:00.752642 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1320/2671] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:00 2022] DELETE /identity/v3/projects/78efdf2848b04b2680d4333cf1534031 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:00.757273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45f48-17c1-4cab-a6a8-0c8555fe7728 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.757568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45f48-17c1-4cab-a6a8-0c8555fe7728 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.757848 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd45f48-17c1-4cab-a6a8-0c8555fe7728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.777800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-bbd45f48-17c1-4cab-a6a8-0c8555fe7728 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:00.778991 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bbd45f48-17c1-4cab-a6a8-0c8555fe7728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.803901 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1352/2672] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:00.813951 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.815503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.838952 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1321/2673] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:00.846075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.846368 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.846646 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.864201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:00.865423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:00.873838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1322/2674] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:00.874245 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a65ff-35c6-4729-8a38-ba3f05b117a2 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.877753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.878231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.879024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.879310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.879587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.888700 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed7c3c-3d1c-4ac6-bfbf-877213425261 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.889676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.891134 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.893525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.894181 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.894459 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.894734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.895462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:31:00.895763 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.897374 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.901207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1353/2675] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:31:00.912377 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1323/2676] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:31:00.916499 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.928790 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5593d-ae5e-4180-bf29-f14260b3fd85 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:00.935113 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:00.936267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:00.936267 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:00.936555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:00.937135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:00.939173 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:00.969960 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1354/2677] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:00.971089 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:00.983400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259fb02-6239-4984-8e74-c9b0c63db4e8 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.041441 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.042197 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.042486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.042747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.044040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.048324 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.065519 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1324/2678] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:00 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:01.069670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.080654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6d1e7-08d9-4e84-a8fc-b71b52285079 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.085343 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.086002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.086283 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.086556 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.087284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.089600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.100242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1355/2679] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:01.104275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.115102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7a0eb-a210-4ffc-9954-b1d43e61ec43 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.121608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.122439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.122730 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.123010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.123754 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.125369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.136439 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1325/2680] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:01.140684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.150715 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7803bf-a842-4294-ba68-67ce7b8aea39 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.155508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62297303-230a-4118-9025-22036ad29441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.156396 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297303-230a-4118-9025-22036ad29441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.156678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297303-230a-4118-9025-22036ad29441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.157062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62297303-230a-4118-9025-22036ad29441 admin admin] PATH_INFO: `/v3/projects/77b8981e99a94a2cbf6fdc730b60e126/users/0236dd0aec3348238c904e95762d1f53/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.174652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297303-230a-4118-9025-22036ad29441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b8981e99a94a2cbf6fdc730b60e126, user_id=0236dd0aec3348238c904e95762d1f53, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.180387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62297303-230a-4118-9025-22036ad29441 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.182059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.184483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.209346 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb2581-48de-4b50-886a-d498b3726cce admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.209881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1356/2681] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:01 2022] PUT /identity/v3/projects/77b8981e99a94a2cbf6fdc730b60e126/users/0236dd0aec3348238c904e95762d1f53/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:01.223508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.223852 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.224062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.252167 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] MFA Rules not processed for user `0236dd0aec3348238c904e95762d1f53`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:01.253405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.273151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.274010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.274294 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.274569 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] PATH_INFO: `/v3/projects/26fda6c29360479fa0cac3c6c939465b` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.275867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fda6c29360479fa0cac3c6c939465b)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.277810 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.319557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1357/2682] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:01.324210 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fda6c29360479fa0cac3c6c939465b', 'request_id': 'req-519f7276-2ca1-42be-a24b-7a7211be05ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.324697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.329486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fda6c29360479fa0cac3c6c939465b', 'request_id': 'req-519f7276-2ca1-42be-a24b-7a7211be05ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.336357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0b68a-3ecb-4be5-8a8f-b0a688d12fcc None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.337227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fda6c29360479fa0cac3c6c939465b', 'request_id': 'req-519f7276-2ca1-42be-a24b-7a7211be05ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.348379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] The token cache is being invalidate because project 26fda6c29360479fa0cac3c6c939465b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:01.348606 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.349282 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.350831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1326/2683] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:01 2022] DELETE /identity/v3/projects/26fda6c29360479fa0cac3c6c939465b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:01.354801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.356136 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.393647 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.394463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.394773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.395079 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.395789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.397796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.418685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f7276-2ca1-42be-a24b-7a7211be05ef admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.426075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1358/2684] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:01 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:01.426253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.426253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.426253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.426253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] PATH_INFO: `/v3/users/f0246db7320a4f1e97caadc43c3bac49` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.426645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0246db7320a4f1e97caadc43c3bac49)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.427796 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.428263 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.429412 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.476206 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0246db7320a4f1e97caadc43c3bac49'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.476931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0246db7320a4f1e97caadc43c3bac49'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.489328 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0246db7320a4f1e97caadc43c3bac49'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.496525 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547114d-31dc-4874-83d8-6a1fd40ffb8a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.497036 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0246db7320a4f1e97caadc43c3bac49'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.497752 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0246db7320a4f1e97caadc43c3bac49'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.502183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.502972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.503257 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.503671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.504471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.506634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.510537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1327/2685] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:01 2022] DELETE /identity/v3/users/f0246db7320a4f1e97caadc43c3bac49 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:01.528779 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1359/2686] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:01 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:01.533577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.535080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.600872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47a08-f548-453e-b1e4-4bf615e9953f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.606736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.607310 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.607595 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.607874 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.608625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.610599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.622535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1328/2687] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:01.626847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.637336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375289f-5ff4-4a39-9759-f7bc8fb1451a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.642110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.642991 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.643272 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.643576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] PATH_INFO: `/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a/users/3398da1a048e4aa09ac9feb5c80bfe1f/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.665394 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d6f2d7a6fa4c0f98da31dfea70269a, user_id=3398da1a048e4aa09ac9feb5c80bfe1f, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.668882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.683416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1360/2688] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:01 2022] PUT /identity/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a/users/3398da1a048e4aa09ac9feb5c80bfe1f/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:01.687301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.697214 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98fc43-295a-48ce-b5b2-3888d7bf7c92 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.755702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.756380 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.756639 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.756945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.757676 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.760311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.772942 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1329/2689] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:01.776086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.787369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7a321-76bc-453a-96f4-439099098af6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.788366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.790322 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.793243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.794256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.794607 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.794952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] PATH_INFO: `/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a/users/3398da1a048e4aa09ac9feb5c80bfe1f/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.797048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d6f2d7a6fa4c0f98da31dfea70269a, user_id=3398da1a048e4aa09ac9feb5c80bfe1f, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.800007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e878f-3030-42af-8e76-0db44c1fa31f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.807485 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae368-d84c-479c-8d19-5072d7ed13c0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:01.813125 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1361/2690] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:01 2022] PUT /identity/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a/users/3398da1a048e4aa09ac9feb5c80bfe1f/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:01.825844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.826156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.826517 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.853232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] MFA Rules not processed for user `3398da1a048e4aa09ac9feb5c80bfe1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:01.854327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.869357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:01.870413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.870682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.870962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] PATH_INFO: `/v3/projects/2a5dbc3ef855423887e07f76aa03c10c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.872173 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5dbc3ef855423887e07f76aa03c10c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:01.874106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:01.919609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5dbc3ef855423887e07f76aa03c10c', 'request_id': 'req-941f9b21-37fb-4a47-b31b-b5fda9cd1389'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.925018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5dbc3ef855423887e07f76aa03c10c', 'request_id': 'req-941f9b21-37fb-4a47-b31b-b5fda9cd1389'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.925427 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1362/2691] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:01.933500 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5dbc3ef855423887e07f76aa03c10c', 'request_id': 'req-941f9b21-37fb-4a47-b31b-b5fda9cd1389'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.936376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:01.937869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.945597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] The token cache is being invalidate because project 2a5dbc3ef855423887e07f76aa03c10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:01.945888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.946555 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-941f9b21-37fb-4a47-b31b-b5fda9cd1389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:01.948690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1330/2692] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:01 2022] DELETE /identity/v3/projects/2a5dbc3ef855423887e07f76aa03c10c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:01.953516 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdf3e-cfbb-4c03-8c47-e1d6e1028c79 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:01.953907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdf3e-cfbb-4c03-8c47-e1d6e1028c79 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:01.954074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44fdf3e-cfbb-4c03-8c47-e1d6e1028c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:01.971508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f44fdf3e-cfbb-4c03-8c47-e1d6e1028c79 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:01.973190 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f44fdf3e-cfbb-4c03-8c47-e1d6e1028c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:01.994355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a705-1018-4e52-96f7-50382c0bda89 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.033141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1331/2693] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:02.041278 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.041597 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.041936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.042526 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.043353 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.043637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.043917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.046107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:02.061270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:02.062495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:02.070761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1332/2694] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:02.075267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.083973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96578-132d-49f7-a4d4-49f68574a28e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.089141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.089779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.090060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.090336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.091063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:31:02.091369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.092972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.104983 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1333/2695] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:31:02.109250 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.111375 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.113108 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.119964 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac6a4a-e073-4057-84c3-fd5b83fb1f9e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.123851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1363/2696] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:02.124734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.125541 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.125833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.126120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.126824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.128723 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.162082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1334/2697] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:02.163210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.174084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a944b2d-3a32-407e-a4ee-4cf00df59745 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.201258 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.203371 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:02.233680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.234349 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.234636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.234916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.235644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.237893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.262569 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1364/2698] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:31:02.263225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a97366-c446-4bf6-9235-a4967dcba694 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.264063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.267071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.267722 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.268009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.268410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.270139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:02.275377 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c41519-7775-4f10-94b1-4e2fc35312ff admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.280769 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.281484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.281767 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.282040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.282777 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.284364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.295574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1365/2699] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:02.299461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.309813 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866d276-66a7-4341-9cff-ee246a2d32a8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.314975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.315633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.315907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.316185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.316929 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.318889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.331081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1366/2700] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:02.331534 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.333101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58d73a-7a01-490c-8db8-70c5ee1fd77f service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.335224 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.342413 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1335/2701] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:31:02.345008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb0be6-2f14-44be-a781-884985edec0a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.349710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.350581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.350867 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.351141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] PATH_INFO: `/v3/projects/cd80ca27cbd44766b466badcdcbffcfe/users/9b75365b247146828047711439991fe0/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.497668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd80ca27cbd44766b466badcdcbffcfe, user_id=9b75365b247146828047711439991fe0, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.500379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.514181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1367/2702] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:02 2022] PUT /identity/v3/projects/cd80ca27cbd44766b466badcdcbffcfe/users/9b75365b247146828047711439991fe0/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:02.524650 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.525043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.525406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.551625 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] MFA Rules not processed for user `9b75365b247146828047711439991fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:02.552831 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:02.616931 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1336/2703] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:02.621461 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.682952 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826710ef-9257-4327-a6c2-95bcf8bf08fb admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.687557 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.688242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.688483 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.688787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.689535 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.691800 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.719037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1368/2704] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:02.723426 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.735304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5e5c6-bf35-4d41-9cf7-6e69e405e980 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.790207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.791424 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.791710 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.791987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.792735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.794630 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.814850 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1337/2705] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:02 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:02.818810 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.831879 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75dcf0-f404-4702-927d-0418550ced94 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.836595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.837323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.837612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.838085 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.838830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.840420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.850235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1369/2706] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:02.854672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.864603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461d19a-8a0e-4f2f-8fc0-2b92b3ea872f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.869986 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.870797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.871080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.871354 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] PATH_INFO: `/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc/users/d68d1b262b08477caf5075c3080884b3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.885765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde200eb19e14d61ad9a8e4350b13dfc, user_id=d68d1b262b08477caf5075c3080884b3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.888432 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.902504 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1338/2707] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:02 2022] PUT /identity/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc/users/d68d1b262b08477caf5075c3080884b3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:02.906681 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.917634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ae7e2-8806-4d07-8e3c-c97528b625e3 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:02.970876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:02.971536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:02.971822 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:02.972096 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:02.972827 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:02.974449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549865b-d2d0-46fe-800a-a3241c354b7d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:02.984506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1370/2708] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:02.989288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:02.999528 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7095578-d27a-4e22-ab22-8a725bc1dc7a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:03.004222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:03.005127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:03.005412 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:03.005690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] PATH_INFO: `/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc/users/d68d1b262b08477caf5075c3080884b3/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:03.007664 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde200eb19e14d61ad9a8e4350b13dfc, user_id=d68d1b262b08477caf5075c3080884b3, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:03.011002 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:03.021151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1339/2709] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:02 2022] PUT /identity/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc/users/d68d1b262b08477caf5075c3080884b3/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:03.032955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:03.033327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:03.033679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:03.059178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] MFA Rules not processed for user `d68d1b262b08477caf5075c3080884b3`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:03.060374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:03.125856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1371/2710] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:03.135944 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:03.189286 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffbbe4-afc6-40cc-9a74-821ecc9da47b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:03.193052 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:03.193702 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:03.193987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:03.194260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:03.249631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:03.251064 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:03.260421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1340/2711] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:10.515049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:10.524585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada46fed-d02f-4881-a1be-c007c060ea55 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:10.528582 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:10.529307 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:10.529585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:10.529854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:10.538481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:10.539896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a29d0-2919-44c7-a121-f87ac0361555 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:10.549791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1372/2712] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:13.484468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:13.485949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:13.550323 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27eb6f3-bd7e-4a4b-afc2-700cb8221a1a service cinder] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:13.554868 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:13.555727 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:13.556012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:13.556290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] PATH_INFO: `/v3/users/0236dd0aec3348238c904e95762d1f53` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:13.558126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0236dd0aec3348238c904e95762d1f53)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:13.560071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:13.602816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0236dd0aec3348238c904e95762d1f53'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:13.604146 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0236dd0aec3348238c904e95762d1f53'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:13.615840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0236dd0aec3348238c904e95762d1f53'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:13.622966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0236dd0aec3348238c904e95762d1f53'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:13.623695 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0236dd0aec3348238c904e95762d1f53'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:13.635314 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1341/2713] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:13 2022] DELETE /identity/v3/users/0236dd0aec3348238c904e95762d1f53 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:13.639816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:13.640280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:13.640376 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:13.657494 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:13.658671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:13.715143 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1373/2714] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:13.725217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:13.726623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:13.785187 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c4d419-872f-4ba3-85d8-2ebcecef0fc2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:13.789082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:13.789740 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:13.790027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:13.790305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:13.800217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:13.801706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:13.811882 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1342/2715] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:14.069300 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.070702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:14.082323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9f21-52c5-4559-9643-d3ac4196ae68 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:14.087009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:14.088337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.088916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.089350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] PATH_INFO: `/v3/projects/77b8981e99a94a2cbf6fdc730b60e126` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.090738 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b8981e99a94a2cbf6fdc730b60e126)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:14.092636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:14.139195 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b8981e99a94a2cbf6fdc730b60e126', 'request_id': 'req-9bfabe94-065d-4def-9061-956e22238d79'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.144584 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b8981e99a94a2cbf6fdc730b60e126', 'request_id': 'req-9bfabe94-065d-4def-9061-956e22238d79'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.152268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b8981e99a94a2cbf6fdc730b60e126', 'request_id': 'req-9bfabe94-065d-4def-9061-956e22238d79'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.163409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] The token cache is being invalidate because project 77b8981e99a94a2cbf6fdc730b60e126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:14.163697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.164340 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.165914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1374/2716] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:14 2022] DELETE /identity/v3/projects/77b8981e99a94a2cbf6fdc730b60e126 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:14.170863 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.180350 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247bb24-7b7d-4ecc-89bd-cfb1d9d3d613 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:14.241576 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:14.242445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.242733 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.243006 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] PATH_INFO: `/v3/users/3398da1a048e4aa09ac9feb5c80bfe1f` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.244422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3398da1a048e4aa09ac9feb5c80bfe1f)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:14.246357 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:14.293617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3398da1a048e4aa09ac9feb5c80bfe1f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.294447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3398da1a048e4aa09ac9feb5c80bfe1f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.306556 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3398da1a048e4aa09ac9feb5c80bfe1f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.313121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3398da1a048e4aa09ac9feb5c80bfe1f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.314049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-24f02fb5-4ca3-45a2-a4f4-d1d60966cf73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3398da1a048e4aa09ac9feb5c80bfe1f'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.329995 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1343/2717] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:14 2022] DELETE /identity/v3/users/3398da1a048e4aa09ac9feb5c80bfe1f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:14.610616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.612406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:14.626281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfabe94-065d-4def-9061-956e22238d79 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:14.682450 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:14.683236 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.683491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.683768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] PATH_INFO: `/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.684998 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d6f2d7a6fa4c0f98da31dfea70269a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:14.686896 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:14.731536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d6f2d7a6fa4c0f98da31dfea70269a', 'request_id': 'req-73b742fc-4fab-40c5-9b66-a158ff7855f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.736643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d6f2d7a6fa4c0f98da31dfea70269a', 'request_id': 'req-73b742fc-4fab-40c5-9b66-a158ff7855f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.744671 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d6f2d7a6fa4c0f98da31dfea70269a', 'request_id': 'req-73b742fc-4fab-40c5-9b66-a158ff7855f9'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.756537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] The token cache is being invalidate because project d0d6f2d7a6fa4c0f98da31dfea70269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:14.756821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.757508 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-73b742fc-4fab-40c5-9b66-a158ff7855f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:14.759028 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1375/2718] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:14 2022] DELETE /identity/v3/projects/d0d6f2d7a6fa4c0f98da31dfea70269a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:14.764982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.765475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.765588 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.783873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:14.785092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:14.842765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1344/2719] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:14.850458 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.850747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.851027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.869831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:14.871022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:14.878933 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1376/2720] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:14.883034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.893525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce186899-266c-4cf3-a24c-16232ffab071 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:14.898112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:14.898761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.899049 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.899325 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] PATH_INFO: `/v3/domains` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.900048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79225) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:31:14.900389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:14.902080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:14.913885 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1345/2721] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 15 04:31:14.918327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.927350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f712029-a237-48b5-afb3-4fe72a2ee237 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:14.932685 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:14.933298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:14.933577 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:14.933847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:14.934546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:14.936413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:14.962432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1377/2722] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:14 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:14.966951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:14.976688 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918523a5-5f9e-4496-8d53-16649eea483a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.030941 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.031608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.031892 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.032169 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] PATH_INFO: `/v3/users` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.032865 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.034797 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.054711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1346/2723] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:14 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:31:15.059470 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.069456 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce283220-eb2b-4014-a12c-b63027500d13 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.074682 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.075329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.075612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.075908 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.076616 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.078253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.089364 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1378/2724] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:15.093474 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.103106 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c3dc2-5b06-4bac-b3a1-eef96ea2df20 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.108470 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.109150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.109437 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.109709 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.110433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.111993 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1764f5f-68aa-46ea-a56a-b387a1c34fe6 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.122811 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1347/2725] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:15.126893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.137413 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e12e1-306e-463e-91e4-dd3369ef5525 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.142177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.143058 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.143322 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.143600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] PATH_INFO: `/v3/projects/5ad32d2477a34442b3d9a8b6a1d3f514/users/c9c8845f08294382ade3749672af4a84/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.158776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad32d2477a34442b3d9a8b6a1d3f514, user_id=c9c8845f08294382ade3749672af4a84, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.161638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.174900 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1379/2726] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:15 2022] PUT /identity/v3/projects/5ad32d2477a34442b3d9a8b6a1d3f514/users/c9c8845f08294382ade3749672af4a84/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:15.185166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.185389 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.185662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.211992 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] MFA Rules not processed for user `c9c8845f08294382ade3749672af4a84`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:15.213821 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.276245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1348/2727] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:15.280727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.343690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e045eed-da04-4e3c-8390-afee640c9579 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.348327 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.349008 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.349296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.349565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.350269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.352154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.373532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.375023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.381763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1380/2728] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:15 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:15.386514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.389651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b89ae-0ac5-4d66-8e2f-fb0abbdd0079 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.448415 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.449245 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.449537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.449815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] PATH_INFO: `/v3/users/9b75365b247146828047711439991fe0` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.451048 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b75365b247146828047711439991fe0)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.451310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40135b73-b46d-4690-be82-1c2955d3ddef admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.453149 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.456046 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.456701 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.457025 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.457306 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.458007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.459894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.482368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1381/2729] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:15 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:15.486690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.497368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0de5b6-80cd-4228-99f3-f54343b52bb1 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.502733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.503400 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.506411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.506411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.506411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.506411 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.514142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b75365b247146828047711439991fe0'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:15.514142 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b75365b247146828047711439991fe0'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:15.517042 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1382/2730] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:15.521921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.522778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b75365b247146828047711439991fe0'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:15.523882 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.531837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b75365b247146828047711439991fe0'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:15.533082 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2990404d-b658-4899-9611-e6c989168a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b75365b247146828047711439991fe0'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:15.537672 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f2502-64cc-40f6-a360-9f9ca2891c2b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.543279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.544166 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.544443 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.544725 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] PATH_INFO: `/v3/projects/3c68f9758037445ca79fd83fc0369110/users/5973644096364f23b38c17963f2b361e/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.547735 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1349/2731] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:15 2022] DELETE /identity/v3/users/9b75365b247146828047711439991fe0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:15.552242 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.552526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.552806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.562893 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68f9758037445ca79fd83fc0369110, user_id=5973644096364f23b38c17963f2b361e, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.565596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.571897 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:15.573761 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.580366 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1383/2732] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:15 2022] PUT /identity/v3/projects/3c68f9758037445ca79fd83fc0369110/users/5973644096364f23b38c17963f2b361e/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:15.584204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.639830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1350/2733] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:15.646710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f47bc-1eac-4944-9795-643200220536 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.650128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.651560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.651821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.652549 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.652826 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.653145 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.653885 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.655457 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.665379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1384/2734] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:15.670141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.679750 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3efb3c-7263-4327-968e-0695b1f45841 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.685983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.686605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.686605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.686787 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] PATH_INFO: `/v3/projects/3c68f9758037445ca79fd83fc0369110/users/5973644096364f23b38c17963f2b361e/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.688878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68f9758037445ca79fd83fc0369110, user_id=5973644096364f23b38c17963f2b361e, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.691640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9d664-9500-4ae8-aff6-90bb1790ad6e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.704320 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1385/2735] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:15 2022] PUT /identity/v3/projects/3c68f9758037445ca79fd83fc0369110/users/5973644096364f23b38c17963f2b361e/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:15.709671 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01dadb-d6d5-4003-a86a-d5c53ab561dc None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.715082 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.715365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.715636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.749077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] MFA Rules not processed for user `5973644096364f23b38c17963f2b361e`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:15.750326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.760113 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.760989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.761270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.761552 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.819430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1386/2736] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:15.821562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.823795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.830644 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:15.831962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.834945 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1351/2737] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:31:15.889598 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83d0cb-f556-4eed-a6f4-6050ea30459c None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:15.893410 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:15.894674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:15.894674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:15.894674 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:15.896747 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:15.958761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:15.960244 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:15.970147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1387/2738] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:31:16.106147 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:16.107847 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:16.126260 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23acd3-9707-476b-9909-ed0f8d0f2c9f service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:16.133012 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:16.134074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.134438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.135462 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] PATH_INFO: `/v3/projects/cd80ca27cbd44766b466badcdcbffcfe` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.136877 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd80ca27cbd44766b466badcdcbffcfe)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:16.139345 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:16.190084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd80ca27cbd44766b466badcdcbffcfe', 'request_id': 'req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.196501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd80ca27cbd44766b466badcdcbffcfe', 'request_id': 'req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.207005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd80ca27cbd44766b466badcdcbffcfe', 'request_id': 'req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.226008 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] The token cache is being invalidate because project cd80ca27cbd44766b466badcdcbffcfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:16.226579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.227972 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.230824 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1352/2739] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:16 2022] DELETE /identity/v3/projects/cd80ca27cbd44766b466badcdcbffcfe => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:16.234917 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:16.246360 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132fa3f-1988-4d69-8652-a5b1956ae85c service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:16.305707 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:16.306624 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.306913 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.307186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] PATH_INFO: `/v3/users/d68d1b262b08477caf5075c3080884b3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.308614 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68d1b262b08477caf5075c3080884b3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:16.310921 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:16.357643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68d1b262b08477caf5075c3080884b3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.369077 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68d1b262b08477caf5075c3080884b3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.369744 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68d1b262b08477caf5075c3080884b3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.376287 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68d1b262b08477caf5075c3080884b3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.384664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-12059cfa-ddfd-4d7e-be82-9753b19c4083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68d1b262b08477caf5075c3080884b3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.391369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1388/2740] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:16 2022] DELETE /identity/v3/users/d68d1b262b08477caf5075c3080884b3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:16.658666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:16.660267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:16.674775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0384ed5-dc3b-44a9-bc30-d13f32498c1c admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:16.731296 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:16.732170 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.732454 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.732731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] PATH_INFO: `/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.733956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde200eb19e14d61ad9a8e4350b13dfc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:16.735889 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:16.782705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde200eb19e14d61ad9a8e4350b13dfc', 'request_id': 'req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.788153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde200eb19e14d61ad9a8e4350b13dfc', 'request_id': 'req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.795712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde200eb19e14d61ad9a8e4350b13dfc', 'request_id': 'req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.806285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] The token cache is being invalidate because project cde200eb19e14d61ad9a8e4350b13dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:16.807163 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.807913 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-763eacd6-5a1b-4482-aa3e-2a651d1d5ce5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:16.809487 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1353/2741] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:16 2022] DELETE /identity/v3/projects/cde200eb19e14d61ad9a8e4350b13dfc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:16.815640 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.816109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.816109 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.836789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:16.839069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:16.895955 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1389/2742] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:16.905969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.906458 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.906557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.925448 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:16.926653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:16.935047 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1354/2743] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:16.939488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:16.949426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea1c27-f964-487a-858f-c96033d305dd None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:16.954690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:16.955404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.955684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.955959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.956689 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:31:16.957144 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:16.958935 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:16.971793 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1390/2744] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:31:16.976771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:16.986705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c535-af4b-4b7f-a345-b617b00fdf36 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:16.991816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:16.992644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:16.992968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:16.993253 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:16.993969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:16.995980 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.021305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1355/2745] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:16 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:31:17.026415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.036354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02957241-0260-45c0-9b1f-8c7885268972 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.090691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.091350 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.091627 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.091898 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.092596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.094692 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.114748 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1391/2746] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:17 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:17.118954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.129592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9bda8-db59-456d-98ef-08b86f31acd0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.134406 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.135182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.135381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.135666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.136405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.138040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.148543 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1356/2747] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:17.153654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.163717 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0942f-a54b-46c2-aa2e-89b8d293928d admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.169184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.169871 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.170150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.170422 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.171185 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.172791 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f013b7-f504-43f3-903a-2a2722811388 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.182657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1392/2748] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:17.186938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.196739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ee50e-0101-412a-b200-c8dcabc91b79 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.202160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.203038 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.203321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.203705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] PATH_INFO: `/v3/projects/81818d3572d647788db923c5bedc8b89/users/893082bb77444c6386529482a4c129a5/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.218386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81818d3572d647788db923c5bedc8b89, user_id=893082bb77444c6386529482a4c129a5, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.221091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.233703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1357/2749] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:17 2022] PUT /identity/v3/projects/81818d3572d647788db923c5bedc8b89/users/893082bb77444c6386529482a4c129a5/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:17.246568 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.246758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.247020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.272714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] MFA Rules not processed for user `893082bb77444c6386529482a4c129a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:17.273922 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:17.337440 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1393/2750] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:17.342520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.405705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cd08-d00e-4829-8e2e-fdd13abadc3f admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.410525 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.411182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.411465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.411747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.412493 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.414451 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.441539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1358/2751] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:17 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:17.445776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.456931 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121fb36-cd48-44f4-8709-3f499015b293 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.517903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.518532 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.518954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.519387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.520337 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.522397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.542589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1394/2752] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:17 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:17.546770 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.558086 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c1ba-4fff-40c1-84f5-a454dbe3207e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.562869 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.563526 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.563817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.564091 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.564822 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.566447 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.576967 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1359/2753] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:17.581256 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.591571 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930fd03-002f-4155-8db6-9f3786861062 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.596086 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.596985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.597268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.597544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] PATH_INFO: `/v3/projects/dec7b01dc20f4fbd8391b441dd213883/users/3c1c5c5b8b154021810d8249c7a0f1f4/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.612639 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec7b01dc20f4fbd8391b441dd213883, user_id=3c1c5c5b8b154021810d8249c7a0f1f4, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.615310 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.628572 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1395/2754] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:17 2022] PUT /identity/v3/projects/dec7b01dc20f4fbd8391b441dd213883/users/3c1c5c5b8b154021810d8249c7a0f1f4/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:17.632802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.642873 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560955ce-4ebe-45c5-b360-14776a82853e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.696887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.697633 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.697919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.698195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.698927 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.700527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963859a0-48fd-4037-baef-744e02d6dda0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.710093 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1360/2755] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:31:17.714880 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.725203 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e816-97c1-4969-8252-9c8a47aebcf5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.730551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.731460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.731768 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.732062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] PATH_INFO: `/v3/projects/dec7b01dc20f4fbd8391b441dd213883/users/3c1c5c5b8b154021810d8249c7a0f1f4/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.734181 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec7b01dc20f4fbd8391b441dd213883, user_id=3c1c5c5b8b154021810d8249c7a0f1f4, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.736812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.747758 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1396/2756] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:17 2022] PUT /identity/v3/projects/dec7b01dc20f4fbd8391b441dd213883/users/3c1c5c5b8b154021810d8249c7a0f1f4/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:17.757932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.758227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.758511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.785108 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] MFA Rules not processed for user `3c1c5c5b8b154021810d8249c7a0f1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:17.786193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:17.854846 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1361/2757] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:17.864993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:17.866720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:17.922776 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a4310-76a1-4d6b-8752-f955945cfbcf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:17.926453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:17.927090 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:17.927373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:17.927652 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:17.980907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:17.982370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:17.991416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1397/2758] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:21.596705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:21.598131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:21.610122 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3445d9-e639-4931-b267-88dd988cfa30 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:21.613950 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:21.614522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:21.614804 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:21.615071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:21.616760 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:21.679010 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:21.680442 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5bf158-bf46-47a2-842c-fba2bbbe74f0 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:21.690638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1362/2759] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:26.748979 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:26.810578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038c3e1-18be-4cae-bc8f-169ae110d8b5 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:26.815110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:26.815962 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:26.816240 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:26.816512 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] PATH_INFO: `/v3/users/893082bb77444c6386529482a4c129a5` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:26.817737 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893082bb77444c6386529482a4c129a5)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:26.819650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:26.865210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893082bb77444c6386529482a4c129a5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:26.877002 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893082bb77444c6386529482a4c129a5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:26.877686 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893082bb77444c6386529482a4c129a5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:26.884207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893082bb77444c6386529482a4c129a5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:26.892471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893082bb77444c6386529482a4c129a5'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:26.898904 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1398/2760] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:26 2022] DELETE /identity/v3/users/893082bb77444c6386529482a4c129a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:26.904026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:26.904499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:26.904617 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:26.922184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:26.923416 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:26.983960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1363/2761] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:26.993844 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:26.995234 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:27.050983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec676ec-c463-444d-ad59-107a07887911 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:27.054670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:27.055305 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:27.055585 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:27.055856 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:27.065943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:27.067371 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:27.076637 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1399/2762] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:27.345218 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:27.346724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:27.361255 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed914d-7d28-47f4-aab9-58ae6512e638 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:27.366202 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:27.367232 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:27.367520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:27.367800 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] PATH_INFO: `/v3/projects/81818d3572d647788db923c5bedc8b89` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:27.369171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=81818d3572d647788db923c5bedc8b89)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:27.371131 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:27.417971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81818d3572d647788db923c5bedc8b89', 'request_id': 'req-f7ed22b5-b72e-43b0-822a-98dad30f21ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.424707 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81818d3572d647788db923c5bedc8b89', 'request_id': 'req-f7ed22b5-b72e-43b0-822a-98dad30f21ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.432501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81818d3572d647788db923c5bedc8b89', 'request_id': 'req-f7ed22b5-b72e-43b0-822a-98dad30f21ef'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.443668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] The token cache is being invalidate because project 81818d3572d647788db923c5bedc8b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:27.443958 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.444607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.446337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1364/2763] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:27 2022] DELETE /identity/v3/projects/81818d3572d647788db923c5bedc8b89 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:27.450976 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:27.463118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e972-2a91-477a-a62b-85edcdf60268 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:27.518763 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:27.519539 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:27.519812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:27.520076 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] PATH_INFO: `/v3/users/3c1c5c5b8b154021810d8249c7a0f1f4` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:27.521282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1c5c5b8b154021810d8249c7a0f1f4)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:27.523284 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:27.569633 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1c5c5b8b154021810d8249c7a0f1f4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.581668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1c5c5b8b154021810d8249c7a0f1f4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.582404 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1c5c5b8b154021810d8249c7a0f1f4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.589589 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1c5c5b8b154021810d8249c7a0f1f4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.598221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c20cb278-33e2-4ed7-a626-e4c393b7b379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1c5c5b8b154021810d8249c7a0f1f4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:27.604604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1400/2764] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:31:27 2022] DELETE /identity/v3/users/3c1c5c5b8b154021810d8249c7a0f1f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:31:27.884430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:27.885888 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:27.899599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed22b5-b72e-43b0-822a-98dad30f21ef admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:27.956753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:27.957645 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:27.957925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:27.958204 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] PATH_INFO: `/v3/projects/dec7b01dc20f4fbd8391b441dd213883` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:27.959405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec7b01dc20f4fbd8391b441dd213883)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:27.961358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.007756 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec7b01dc20f4fbd8391b441dd213883', 'request_id': 'req-f9afb5e0-628b-4f51-b63d-1353097d3a82'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:28.014405 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec7b01dc20f4fbd8391b441dd213883', 'request_id': 'req-f9afb5e0-628b-4f51-b63d-1353097d3a82'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:28.021963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec7b01dc20f4fbd8391b441dd213883', 'request_id': 'req-f9afb5e0-628b-4f51-b63d-1353097d3a82'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:28.033937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] The token cache is being invalidate because project dec7b01dc20f4fbd8391b441dd213883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:31:28.034223 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:28.034860 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-f9afb5e0-628b-4f51-b63d-1353097d3a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:31:28.036382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1365/2765] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:31:27 2022] DELETE /identity/v3/projects/dec7b01dc20f4fbd8391b441dd213883 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:28.041369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.041977 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.042097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.060444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:28.061587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:28.118697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1401/2766] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:28.127376 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.127663 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.127939 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.146600 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:28.147778 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:28.156430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1366/2767] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:28.160635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.170560 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc406906-6003-4ce3-8ea1-da3c80aab934 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.175199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.175842 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.176118 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.176389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.177159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:31:28.177464 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.179047 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.194721 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1402/2768] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:31:28.199007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.209152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce668e-5f80-4ebc-a161-88ab21f90c60 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.213742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.214384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.214665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.214940 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.216014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.217949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.242401 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1367/2769] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:31:28 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:31:28.247252 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.257037 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f9b07-f3eb-4775-a786-663b7835a039 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.312041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.312655 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.312964 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.313246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.313957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.315877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.337552 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1403/2770] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:31:28 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:31:28.341932 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.354400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359bf980-da47-4278-8e86-73e7ee53fbb2 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.359317 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.360112 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.360398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.360679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.361456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.363288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.374530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1368/2771] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:28.378406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.389061 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509d791-a920-419c-960f-6fa153a1a2f4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.393709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.394365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.394645 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.394924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.395658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.397279 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02a617-218e-4ea9-86aa-b0ef799bbaa4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.407489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1404/2772] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:31:28.411840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.422768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc70d8d-7802-42d2-ad16-6bd8f29073fd admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.427480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.428358 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.428635 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.429053 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] PATH_INFO: `/v3/projects/52fde05e0f5b4f99bef9ea3a704042f7/users/2d34cf2d160643b08dbb3be564408b34/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.447126 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fde05e0f5b4f99bef9ea3a704042f7, user_id=2d34cf2d160643b08dbb3be564408b34, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.451662 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.465973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1369/2773] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:31:28 2022] PUT /identity/v3/projects/52fde05e0f5b4f99bef9ea3a704042f7/users/2d34cf2d160643b08dbb3be564408b34/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:31:28.477407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.477709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.477991 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.506944 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] MFA Rules not processed for user `2d34cf2d160643b08dbb3be564408b34`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:28.508133 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:28.572978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1405/2774] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:31:28.582765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:28.584532 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:28.641776 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20018624-3a5d-4235-bf24-e5842ee02190 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:28.646063 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:28.646711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:28.647001 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:28.647280 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:28.655966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:28.657513 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b65b6d-b682-4329-a0b4-5d7df0a6a0ce service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:28.666618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1370/2775] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:48.573994 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:48.576329 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:48.653735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e961f4-3888-4d58-87e9-b1cf1d832d4e None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:48.662378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:48.663189 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:48.663476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:48.663752 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:48.669161 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:48.682565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:48.684149 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:48.695544 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1406/2776] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:50.008162 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:50.008672 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:50.008862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:50.027970 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] MFA Rules not processed for user `38c585ad31ef4f50bd695bb379107a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:31:50.031062 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:50.092073 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1371/2777] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:31:50.425390 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:50.426905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:50.484071 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea93c84-aeb8-483d-8422-5ecc5ebc6636 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:50.487961 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:50.488611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:50.489005 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:50.489289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:50.491073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:50.502165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:50.503634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:50.512641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1407/2778] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:31:50.943623 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:31:50.945138 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:51.015151 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70838cd-534f-4c12-be3b-0c8d18d9667f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:31:51.020298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:31:51.020785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:31:51.021107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:31:51.021386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:31:51.023152 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:31:51.034582 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:31:51.036158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990706b5-4886-4988-8624-5cb832b7c6d3 service placement] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:31:51.046446 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1372/2779] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:31:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:02.702460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:02.704048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:02.768937 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfd3b-becc-43e3-88a7-6fd76db22d2a service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:02.773399 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:02.774271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:02.774537 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:02.774812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] PATH_INFO: `/v3/users/c9c8845f08294382ade3749672af4a84` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:02.776022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c8845f08294382ade3749672af4a84)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:02.777983 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:02.823513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c8845f08294382ade3749672af4a84'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:02.836723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c8845f08294382ade3749672af4a84'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:02.837430 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c8845f08294382ade3749672af4a84'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:02.844872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c8845f08294382ade3749672af4a84'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:02.852289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c8845f08294382ade3749672af4a84'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:02.858044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1408/2780] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:02 2022] DELETE /identity/v3/users/c9c8845f08294382ade3749672af4a84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:02.863199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:02.863713 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:02.863890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:02.881235 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:02.882433 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:02.939456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1373/2781] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:02.949059 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:02.950482 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:03.008683 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc6d3-9204-4a43-923e-95196c275479 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:03.012452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:03.013124 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:03.013418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:03.013698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:03.023365 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:03.024746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:03.034551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1409/2782] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:03.313120 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:03.314578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:03.326638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea064829-ed5c-455b-9339-ac72d36eaf39 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:03.332669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:03.333658 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:03.333948 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:03.334225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] PATH_INFO: `/v3/projects/5ad32d2477a34442b3d9a8b6a1d3f514` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:03.335489 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad32d2477a34442b3d9a8b6a1d3f514)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:03.337527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:03.383934 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad32d2477a34442b3d9a8b6a1d3f514', 'request_id': 'req-4407dfe2-1c5a-4841-a25b-7616f5b726ce'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.389792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad32d2477a34442b3d9a8b6a1d3f514', 'request_id': 'req-4407dfe2-1c5a-4841-a25b-7616f5b726ce'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.397274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad32d2477a34442b3d9a8b6a1d3f514', 'request_id': 'req-4407dfe2-1c5a-4841-a25b-7616f5b726ce'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.409300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] The token cache is being invalidate because project 5ad32d2477a34442b3d9a8b6a1d3f514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:03.409607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.410316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.412228 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1374/2783] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:03 2022] DELETE /identity/v3/projects/5ad32d2477a34442b3d9a8b6a1d3f514 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:03.416481 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:03.426583 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e321e2-fa42-4708-9b19-74d04b2dd53a service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:03.483371 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:03.484269 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:03.484550 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:03.484817 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] PATH_INFO: `/v3/users/5973644096364f23b38c17963f2b361e` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:03.486040 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5973644096364f23b38c17963f2b361e)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:03.488198 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:03.534418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5973644096364f23b38c17963f2b361e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.545562 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5973644096364f23b38c17963f2b361e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.546238 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5973644096364f23b38c17963f2b361e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.554714 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5973644096364f23b38c17963f2b361e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.563816 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-91154259-f349-4f6f-9bce-efde07844aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5973644096364f23b38c17963f2b361e'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.569993 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1410/2784] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:03 2022] DELETE /identity/v3/users/5973644096364f23b38c17963f2b361e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:03.856953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:03.858438 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:03.871840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407dfe2-1c5a-4841-a25b-7616f5b726ce admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:03.928455 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:03.929360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:03.929649 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:03.929960 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] PATH_INFO: `/v3/projects/3c68f9758037445ca79fd83fc0369110` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:03.931150 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68f9758037445ca79fd83fc0369110)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:03.933084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:03.978305 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68f9758037445ca79fd83fc0369110', 'request_id': 'req-6b03f86e-035e-49b1-b47e-4322352e2804'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.983708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68f9758037445ca79fd83fc0369110', 'request_id': 'req-6b03f86e-035e-49b1-b47e-4322352e2804'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:03.991074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68f9758037445ca79fd83fc0369110', 'request_id': 'req-6b03f86e-035e-49b1-b47e-4322352e2804'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.002132 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] The token cache is being invalidate because project 3c68f9758037445ca79fd83fc0369110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:04.002418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.003051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-6b03f86e-035e-49b1-b47e-4322352e2804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.004562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1375/2785] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:03 2022] DELETE /identity/v3/projects/3c68f9758037445ca79fd83fc0369110 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:04.009359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.009839 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.009954 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.027048 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:04.028215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.085902 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1411/2786] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:04.093975 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.094511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.094838 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.113973 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:04.115155 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.122903 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1376/2787] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:04.127276 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.136795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d532d-2029-400e-9d96-3f7dc255f235 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.141564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058483-1522-421f-a147-40099e996986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.142209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058483-1522-421f-a147-40099e996986 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.142489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058483-1522-421f-a147-40099e996986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.142764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f058483-1522-421f-a147-40099e996986 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.143492 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f058483-1522-421f-a147-40099e996986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:32:04.143797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f058483-1522-421f-a147-40099e996986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.145426 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f058483-1522-421f-a147-40099e996986 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.157253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1412/2788] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:32:04.161982 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.172592 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a6b68-cf2a-4226-8db9-c61e89863464 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.177428 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.178078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.178366 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.178648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.179360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.181298 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.205792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1377/2789] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:04.209978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058483-1522-421f-a147-40099e996986 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.220594 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f058483-1522-421f-a147-40099e996986 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.273959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.274619 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.274905 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.275186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.275881 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.277832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.303170 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1413/2790] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:04.303356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.303356 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.304635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.314641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011b21c-c5d5-437d-8c4f-ac7ee28a1fdd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.315607 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8c842-c684-4f3a-86d7-3daeccff9af9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.319271 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.319914 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.320153 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.320321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.320433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.321107 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.321242 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.321392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.321667 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] PATH_INFO: `/v3/users/2d34cf2d160643b08dbb3be564408b34` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.322785 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.322909 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d34cf2d160643b08dbb3be564408b34)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.324732 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.333845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1414/2791] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:04.337963 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.348695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7774b-f7f8-470c-9188-dd1c7f97d854 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.354576 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.355208 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.355522 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.355957 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.356794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.358926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.371392 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1415/2792] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:04.374085 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d34cf2d160643b08dbb3be564408b34'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.375032 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d34cf2d160643b08dbb3be564408b34'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.375831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.377696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.389643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d34cf2d160643b08dbb3be564408b34'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.392854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4e4c-517c-4ffb-b9cf-702928c12830 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.397521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d34cf2d160643b08dbb3be564408b34'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.398174 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.398311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-a5c6aba0-64a8-4617-8cf7-9c1bb156a5fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d34cf2d160643b08dbb3be564408b34'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.399697 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.400207 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.400702 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] PATH_INFO: `/v3/projects/1d2747d713394951b49aef67d43bb6e2/users/ad0758bc907047a59707564c2fb0c48b/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.414071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1378/2793] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:04 2022] DELETE /identity/v3/users/2d34cf2d160643b08dbb3be564408b34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:04.418616 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.418923 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.419200 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.420334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2747d713394951b49aef67d43bb6e2, user_id=ad0758bc907047a59707564c2fb0c48b, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.423111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8554a-8e2a-44b7-86ad-66c25f456785 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.436154 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1416/2794] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:04 2022] PUT /identity/v3/projects/1d2747d713394951b49aef67d43bb6e2/users/ad0758bc907047a59707564c2fb0c48b/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:04.438005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:04.439290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.446930 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.447212 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.447485 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.474630 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] MFA Rules not processed for user `ad0758bc907047a59707564c2fb0c48b`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:04.475831 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.499450 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1379/2795] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:04.509039 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.510395 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.541354 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1417/2796] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:04.545406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.555965 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29dc52-1242-48a1-bdc0-0bcae83a5699 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.560527 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.561209 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.561487 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.561760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.563186 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.565445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.567392 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cbee2-5dcc-4317-980a-d250148abde4 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.571103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.571747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.572034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.572316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.583836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.585694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.595056 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1418/2797] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:04.595996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.596653 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1380/2798] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:32:04.661147 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95749-d50e-41db-b6f7-b2b72adbfc78 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.666437 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.667175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.667463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.667742 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.668484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.670447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.695222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1419/2799] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:04.696654 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.706815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca768-857c-4f58-be5d-0ff90922f1bb service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.711685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.712475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.712809 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.713213 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.714027 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.715691 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.727035 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1381/2800] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:04.731540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.743784 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aa4ca-a654-4cca-8174-b0cc10bfc8e6 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.752684 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.753678 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.753956 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.754241 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] PATH_INFO: `/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52/users/27323c058eef4cc8a3e3947c1c2bd6f8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.774876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=556c1e898ffd4c3d8f6425cdf35cea52, user_id=27323c058eef4cc8a3e3947c1c2bd6f8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.777554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.792488 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1420/2801] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:04 2022] PUT /identity/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52/users/27323c058eef4cc8a3e3947c1c2bd6f8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:04.797079 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.807467 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecf9ff-984b-4653-bf3d-2d52ac8e7ac3 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.867474 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.869959 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.877657 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.878431 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.878737 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.878979 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.879866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.883057 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.895097 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc99d11-0a7d-4b94-9c9e-aadff1366f10 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.899318 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1382/2802] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:04.901608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:04.904001 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.904869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.905187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.905468 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] PATH_INFO: `/v3/projects/52fde05e0f5b4f99bef9ea3a704042f7` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.907420 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fde05e0f5b4f99bef9ea3a704042f7)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.909368 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.916128 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c60f6-a269-4de2-b2ae-fb16b515eb3b admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:04.923539 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:04.924435 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.924714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.925029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] PATH_INFO: `/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52/users/27323c058eef4cc8a3e3947c1c2bd6f8/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.927189 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=556c1e898ffd4c3d8f6425cdf35cea52, user_id=27323c058eef4cc8a3e3947c1c2bd6f8, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:04.929867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1c34-7f6c-40c8-8339-312ee8375c6a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:04.942004 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1383/2803] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:04 2022] PUT /identity/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52/users/27323c058eef4cc8a3e3947c1c2bd6f8/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:04.951736 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:04.952092 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:04.952398 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:04.963704 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fde05e0f5b4f99bef9ea3a704042f7', 'request_id': 'req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.970887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fde05e0f5b4f99bef9ea3a704042f7', 'request_id': 'req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.980087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fde05e0f5b4f99bef9ea3a704042f7', 'request_id': 'req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.982148 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] MFA Rules not processed for user `27323c058eef4cc8a3e3947c1c2bd6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:04.984479 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:04.992772 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] The token cache is being invalidate because project 52fde05e0f5b4f99bef9ea3a704042f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79226) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:04.993094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:04.993788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:05.005043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1421/2804] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:04 2022] DELETE /identity/v3/projects/52fde05e0f5b4f99bef9ea3a704042f7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:05.064087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1384/2805] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:05.075610 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:05.077325 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:05.139565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c8da1-1ca0-41f1-9099-e6c3d847f7a4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:05.143588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:05.144260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:05.144538 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:05.144814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:05.155341 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:05.156851 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:05.167730 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1422/2806] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:05.249381 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:05.259523 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64461bd-8ef2-4288-9664-7f1adaa2659c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:05.263076 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:05.263711 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:05.264024 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:05.264301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:05.266193 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:05.323393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:05.324825 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c31c2d-e983-4694-b05d-db4a3244eeba service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:05.333751 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1385/2807] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:09.917928 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:09.919312 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:09.983281 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb20ba3-0696-44b9-99f3-5e72434866fd service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:09.988261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:09.989171 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:09.989452 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:09.989729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] PATH_INFO: `/v3/users/ad0758bc907047a59707564c2fb0c48b` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:09.990927 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0758bc907047a59707564c2fb0c48b)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:09.992832 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:10.039643 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0758bc907047a59707564c2fb0c48b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.055391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0758bc907047a59707564c2fb0c48b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.056091 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0758bc907047a59707564c2fb0c48b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.063479 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0758bc907047a59707564c2fb0c48b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.070781 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0758bc907047a59707564c2fb0c48b'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.076651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1423/2808] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:09 2022] DELETE /identity/v3/users/ad0758bc907047a59707564c2fb0c48b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:10.081862 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:10.082373 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:10.082475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:10.100192 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:10.101336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:10.161801 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1386/2809] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:10.172489 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:10.173924 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:10.229545 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e61c1-6c46-4dae-b473-2c508db32555 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:10.233235 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:10.233897 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:10.234273 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:10.234554 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:10.243811 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:10.245262 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:10.255282 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1424/2810] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:10.523241 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:10.524886 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:10.538549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219c911-814c-4519-8eb6-6ddea747644c None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:10.543201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:10.544074 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:10.544351 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:10.544621 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] PATH_INFO: `/v3/projects/1d2747d713394951b49aef67d43bb6e2` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:10.545854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2747d713394951b49aef67d43bb6e2)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:10.548184 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:10.597315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2747d713394951b49aef67d43bb6e2', 'request_id': 'req-8fcba0fb-9316-4238-b8c8-61946fb30886'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.602708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2747d713394951b49aef67d43bb6e2', 'request_id': 'req-8fcba0fb-9316-4238-b8c8-61946fb30886'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.610631 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2747d713394951b49aef67d43bb6e2', 'request_id': 'req-8fcba0fb-9316-4238-b8c8-61946fb30886'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.622121 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] The token cache is being invalidate because project 1d2747d713394951b49aef67d43bb6e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:10.622408 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.623065 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.624666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1387/2811] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:10 2022] DELETE /identity/v3/projects/1d2747d713394951b49aef67d43bb6e2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:10.628967 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:10.638578 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0bdc12-b2f0-4599-83d6-ff378d21267f service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:10.696049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:10.696980 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:10.697260 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:10.697530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] PATH_INFO: `/v3/users/27323c058eef4cc8a3e3947c1c2bd6f8` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:10.698735 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27323c058eef4cc8a3e3947c1c2bd6f8)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:10.701155 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:10.751334 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27323c058eef4cc8a3e3947c1c2bd6f8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.766868 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27323c058eef4cc8a3e3947c1c2bd6f8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.767870 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27323c058eef4cc8a3e3947c1c2bd6f8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.776206 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27323c058eef4cc8a3e3947c1c2bd6f8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.785231 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-02945ad8-6d3f-497a-8ec2-c41a0f9baf55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27323c058eef4cc8a3e3947c1c2bd6f8'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:10.795824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1425/2812] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:10 2022] DELETE /identity/v3/users/27323c058eef4cc8a3e3947c1c2bd6f8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:11.128259 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.129775 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:11.146594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcba0fb-9316-4238-b8c8-61946fb30886 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.203747 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.204610 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.204887 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.205195 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] PATH_INFO: `/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.206384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=556c1e898ffd4c3d8f6425cdf35cea52)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.208272 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.253100 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556c1e898ffd4c3d8f6425cdf35cea52', 'request_id': 'req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:11.258307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556c1e898ffd4c3d8f6425cdf35cea52', 'request_id': 'req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:11.266517 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556c1e898ffd4c3d8f6425cdf35cea52', 'request_id': 'req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:11.277285 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] The token cache is being invalidate because project 556c1e898ffd4c3d8f6425cdf35cea52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:11.277578 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:11.278201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-39c6f0fe-1397-4663-b7a1-e88e8a7d3ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:11.279712 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1388/2813] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:11 2022] DELETE /identity/v3/projects/556c1e898ffd4c3d8f6425cdf35cea52 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:11.284691 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.285215 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.285326 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.304106 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:11.305323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:11.364013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1426/2814] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:11.372853 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.373114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.373393 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.392009 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:11.393239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:11.401069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1389/2815] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:11.405184 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.414874 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db6dc7-e1f0-4f44-925e-93ddc56c8d25 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.419463 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.420104 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.420386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.420656 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.421972 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:32:11.422274 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.423865 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.435089 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1427/2816] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:32:11.439920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.448920 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f8855-16c0-4f07-9b84-1a15dda45c6b None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.453750 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.454391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.454678 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.454956 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.455651 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.457591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.483420 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1390/2817] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:11 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:11.488631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.498596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa1a03-d8fd-43ed-8775-c62e99809c96 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.552600 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.553294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.553573 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.553845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.554540 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.556432 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.575592 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1428/2818] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:11 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:11.580040 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.590427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c8f4a-e6a4-4fc3-9231-607e0d4692ad admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.595724 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.596379 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.596681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.596968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.597708 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.599300 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.610320 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1391/2819] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:11.614657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.624438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9499-a12b-41b8-9c64-5627411ad090 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.629022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.629670 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.629949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.630219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.630940 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.632541 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee399b-ab2c-4c1b-8432-276f7ce5530e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.642431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1429/2820] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:11.646598 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.657029 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14932c73-73a8-4a49-9715-09da808ca073 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.661859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.662734 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.663020 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.663299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] PATH_INFO: `/v3/projects/27866044efef4b5ebd80d131be9a9c1c/users/b9b1fad332d240c3b022ad0f12d631e3/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.678785 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27866044efef4b5ebd80d131be9a9c1c, user_id=b9b1fad332d240c3b022ad0f12d631e3, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.681557 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.694618 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1392/2821] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:11 2022] PUT /identity/v3/projects/27866044efef4b5ebd80d131be9a9c1c/users/b9b1fad332d240c3b022ad0f12d631e3/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:11.704690 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.705023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.705301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.732676 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] MFA Rules not processed for user `b9b1fad332d240c3b022ad0f12d631e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:11.735317 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:11.799587 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1430/2822] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:11.809495 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.811186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:11.869962 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da779090-3de9-425c-b444-8e2b99f99ef9 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.873668 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.874308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.874669 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.874878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.883239 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.884661 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c93076-999d-4d1a-8263-26289becb2de service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:11.894207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1393/2823] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:11.913729 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:11.975378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63c3a-2957-4047-ac55-1862164be973 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:11.980150 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:11.981041 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:11.981330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:11.981609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] PATH_INFO: `/v3/users/b9b1fad332d240c3b022ad0f12d631e3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:11.982833 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b1fad332d240c3b022ad0f12d631e3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:11.985022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.032860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b1fad332d240c3b022ad0f12d631e3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.044794 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b1fad332d240c3b022ad0f12d631e3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.045634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b1fad332d240c3b022ad0f12d631e3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.052916 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b1fad332d240c3b022ad0f12d631e3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.060510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b1fad332d240c3b022ad0f12d631e3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.066722 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1431/2824] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:11 2022] DELETE /identity/v3/users/b9b1fad332d240c3b022ad0f12d631e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:12.071319 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.071603 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.071914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.114608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:12.115985 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:12.192608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1394/2825] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:12.202374 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.204641 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:12.263135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ec8a-a2b4-49a1-aeb7-4f0b2431c1f8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.267629 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.268268 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.268548 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.268824 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.277675 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.279084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce316-b2fc-409e-86b8-716f60b5ceb1 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.288542 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1432/2826] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:12.568508 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.570110 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:12.587925 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28b9a8-621d-486b-bc16-bfe3aaed7e31 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.593127 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.594178 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.594414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.594768 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] PATH_INFO: `/v3/projects/27866044efef4b5ebd80d131be9a9c1c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.595965 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27866044efef4b5ebd80d131be9a9c1c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.597937 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.644527 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27866044efef4b5ebd80d131be9a9c1c', 'request_id': 'req-25f385f0-335a-4d45-b3c1-3ac60e5007e1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.649792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27866044efef4b5ebd80d131be9a9c1c', 'request_id': 'req-25f385f0-335a-4d45-b3c1-3ac60e5007e1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.657277 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27866044efef4b5ebd80d131be9a9c1c', 'request_id': 'req-25f385f0-335a-4d45-b3c1-3ac60e5007e1'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.668483 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] The token cache is being invalidate because project 27866044efef4b5ebd80d131be9a9c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:12.668771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.669456 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-25f385f0-335a-4d45-b3c1-3ac60e5007e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:12.670989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1395/2827] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:12 2022] DELETE /identity/v3/projects/27866044efef4b5ebd80d131be9a9c1c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:12.676693 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.677014 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.677294 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.704739 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:12.705943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:12.764391 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1433/2828] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:12.772222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.772522 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.772808 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.790802 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:12.792037 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:12.800421 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1396/2829] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:12.804513 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.814468 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e8b9d-830a-4f86-8666-f62af371c6fb None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.819476 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.820127 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.820409 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.820680 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.821444 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:32:12.821749 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.823324 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.835263 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1434/2830] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:32:12.839501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.848579 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeaf5af-b427-47fb-9560-2feab8d0b31f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.853311 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.853951 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.854230 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.854505 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.855207 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.857115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.882665 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1397/2831] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:12.886696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.896814 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e1792-328b-43b3-bdce-9118ac5b1a4f admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.951308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.951968 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.952250 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.952555 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.953510 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.955419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:12.975471 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1435/2832] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:12 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:12.979599 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:12.990703 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec0f6f-a1c2-499d-b9b3-08b4be30808e admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:12.995337 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:12.995987 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:12.996270 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:12.996544 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:12.997308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:12.998893 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:13.009205 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1398/2833] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:13.013355 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:13.023403 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee54a27-5dba-4967-92ab-aec410d8cb61 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:13.028248 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:13.028907 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:13.029199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:13.029473 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:13.030210 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:13.032536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27eec61-07f0-49d3-a385-56839150f90a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:13.042266 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1436/2834] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:13.047033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:13.057222 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8027afd-2603-4112-800b-33d0b3e71528 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:13.061912 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:13.062783 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:13.063069 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:13.063355 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] PATH_INFO: `/v3/projects/9c4244ff599f425b827fa1e2d018840c/users/41d20c3129d04cc6b3b163fde11ef990/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:13.077299 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4244ff599f425b827fa1e2d018840c, user_id=41d20c3129d04cc6b3b163fde11ef990, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:13.080007 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:13.093638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1399/2835] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:13 2022] PUT /identity/v3/projects/9c4244ff599f425b827fa1e2d018840c/users/41d20c3129d04cc6b3b163fde11ef990/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:13.105073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:13.105386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:13.105663 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:13.132280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] MFA Rules not processed for user `41d20c3129d04cc6b3b163fde11ef990`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:13.133490 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:13.198546 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1437/2836] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:13.207827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:13.209644 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:13.282943 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d2dd7-d1fb-4491-b003-0774d1a67015 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:13.286685 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:13.287330 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:13.287611 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:13.287890 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:13.297224 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:13.298854 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1552ec-5305-4fe8-bbfe-82420a56b392 service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:13.307609 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1400/2837] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:16.306397 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:16.384346 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6da205-b552-42ef-b22d-4b27c02d8426 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:16.389020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:16.389876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:16.390183 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:16.390497 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] PATH_INFO: `/v3/users/41d20c3129d04cc6b3b163fde11ef990` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:16.392418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d20c3129d04cc6b3b163fde11ef990)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:16.394367 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:16.438515 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d20c3129d04cc6b3b163fde11ef990'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:16.449694 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d20c3129d04cc6b3b163fde11ef990'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:16.450356 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d20c3129d04cc6b3b163fde11ef990'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:16.458031 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d20c3129d04cc6b3b163fde11ef990'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:16.464869 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d20c3129d04cc6b3b163fde11ef990'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:16.474762 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1438/2838] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:16 2022] DELETE /identity/v3/users/41d20c3129d04cc6b3b163fde11ef990 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:16.479361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:16.479826 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:16.479949 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:16.498742 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:16.499930 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:16.557468 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1401/2839] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:16.567243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:16.568638 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:16.646156 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fb85a-8c2a-4150-93e3-00736ea61e27 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:16.649889 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:16.650530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:16.650812 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:16.651087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:16.660612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:16.662069 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7df2-40b2-422e-86a1-a3d3ffd3e51d service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:16.671418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1439/2840] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:16.931989 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:16.933562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:16.945815 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f91d7-384d-4117-9b98-f7437db4c715 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:16.950968 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:16.952014 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:16.952308 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:16.952587 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] PATH_INFO: `/v3/projects/9c4244ff599f425b827fa1e2d018840c` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:16.954417 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4244ff599f425b827fa1e2d018840c)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:16.956399 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.006101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4244ff599f425b827fa1e2d018840c', 'request_id': 'req-1f01d992-92c5-49f9-8a94-c62813a8a0f2'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.011560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4244ff599f425b827fa1e2d018840c', 'request_id': 'req-1f01d992-92c5-49f9-8a94-c62813a8a0f2'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.019902 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4244ff599f425b827fa1e2d018840c', 'request_id': 'req-1f01d992-92c5-49f9-8a94-c62813a8a0f2'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.030628 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] The token cache is being invalidate because project 9c4244ff599f425b827fa1e2d018840c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:17.030919 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.031547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-1f01d992-92c5-49f9-8a94-c62813a8a0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.033839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1402/2841] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:16 2022] DELETE /identity/v3/projects/9c4244ff599f425b827fa1e2d018840c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:17.039095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.039387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.039664 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.067151 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:17.068447 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.126523 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1440/2842] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:17.134225 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.134530 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.134806 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.153830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:17.155018 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.163043 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1403/2843] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:17.167635 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.177830 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a768fa-8297-491b-9b59-2710315db04b None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.182370 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.183006 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.183289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.183564 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.184291 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:32:17.184596 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.186228 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.198359 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1441/2844] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:32:17.202589 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.211878 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b792e-d594-477c-97f7-7b2e0d887f5f None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.216521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.217275 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.217564 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.217856 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.218549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.220473 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.246003 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1404/2845] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:17.253634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.263445 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba977e-24df-4650-b6df-59f2922f0b03 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.318290 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.318947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.319221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.319519 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.320219 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.322164 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.341720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1442/2846] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:17.346077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.356071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faf6ce-3f54-43d3-abbd-5851128d7bd4 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.361670 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.362593 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.362880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.363158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.363904 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.365540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.376290 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1405/2847] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:17.380417 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.390152 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d4022-4d06-402b-b06c-c4dfddc7ac5a admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.394872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.395514 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.395789 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.396062 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.396804 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.398407 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da286e8-3b2c-4002-94ee-925c86ed0b99 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.408945 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1443/2848] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:17.413267 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.423706 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6022-cfc6-4dd0-8d49-0bac145de23a admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.428400 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.429315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.429602 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.429881 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] PATH_INFO: `/v3/projects/5acc91396ec7405590e718143314ebcf/users/0609f8561a7d4d1d9494870a941fa464/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.443880 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5acc91396ec7405590e718143314ebcf, user_id=0609f8561a7d4d1d9494870a941fa464, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.446568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.459341 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1406/2849] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:17 2022] PUT /identity/v3/projects/5acc91396ec7405590e718143314ebcf/users/0609f8561a7d4d1d9494870a941fa464/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:17.471232 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.471650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.471795 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.498765 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] MFA Rules not processed for user `0609f8561a7d4d1d9494870a941fa464`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:17.499883 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.561187 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1444/2850] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:17.571423 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.573123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.628161 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009f02d-c690-4bb0-af89-a98ea823fe98 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.631840 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.632480 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.632765 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.633078 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.641914 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.643369 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1fd97-8184-4d47-975b-55b653d14f4d service cinder] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.652430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1407/2851] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:17.678336 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.742110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77fa9a6-9c2f-417c-be39-827f5c0d95ac None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.746861 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.747745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.748023 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.748301 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] PATH_INFO: `/v3/users/0609f8561a7d4d1d9494870a941fa464` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.749632 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0609f8561a7d4d1d9494870a941fa464)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.751534 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:17.796453 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0609f8561a7d4d1d9494870a941fa464'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.808261 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0609f8561a7d4d1d9494870a941fa464'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.809026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0609f8561a7d4d1d9494870a941fa464'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.815878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0609f8561a7d4d1d9494870a941fa464'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.823132 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0609f8561a7d4d1d9494870a941fa464'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:17.829734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1445/2852] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:32:17 2022] DELETE /identity/v3/users/0609f8561a7d4d1d9494870a941fa464 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:17.834274 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.834590 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.834870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.853327 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:17.854509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.910436 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1408/2853] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:17.920026 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:17.921451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:17.978178 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f267a-ea51-4bc4-977e-c5c727b4b23e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:17.981798 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:17.982438 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:17.982720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:17.982996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:17.992530 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:17.994007 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba03d7-2a19-494a-a054-c3be3c7efa69 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.004049 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1446/2854] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:18.260608 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.262158 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:18.276997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462448b-383c-4f97-8f0f-2f87e555de50 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.281637 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.282591 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.282872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.283143 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] PATH_INFO: `/v3/projects/5acc91396ec7405590e718143314ebcf` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.284384 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5acc91396ec7405590e718143314ebcf)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.286321 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.331407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5acc91396ec7405590e718143314ebcf', 'request_id': 'req-9956266b-e73f-4707-900f-e29f5444fca4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:18.336464 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5acc91396ec7405590e718143314ebcf', 'request_id': 'req-9956266b-e73f-4707-900f-e29f5444fca4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:18.343386 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5acc91396ec7405590e718143314ebcf', 'request_id': 'req-9956266b-e73f-4707-900f-e29f5444fca4'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:18.354067 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] The token cache is being invalidate because project 5acc91396ec7405590e718143314ebcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:32:18.354382 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:18.355005 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-9956266b-e73f-4707-900f-e29f5444fca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:32:18.356521 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1409/2855] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:32:18 2022] DELETE /identity/v3/projects/5acc91396ec7405590e718143314ebcf => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:18.361754 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.362491 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.362611 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.389709 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:18.390878 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:18.449710 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1447/2856] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:18.459104 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.459396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.459681 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.478728 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:18.480839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:18.493087 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1410/2857] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:18.501536 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.513687 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01cf5-074f-4049-ac33-95df6f032e62 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.519044 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.519695 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.519978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.520253 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.521024 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79226) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 15 04:32:18.521332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.522926 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.534419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1448/2858] 10.222.0.45 () {58 vars in 1152 bytes} [Tue Feb 15 04:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 15 04:32:18.538855 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.548410 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f699a2-2fca-4e18-aee7-ce24ca3664fb None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.553186 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.553830 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.554114 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.554390 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.555080 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.557026 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.583475 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1411/2859] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:18 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:18.587660 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.597565 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde573a-b8d4-4cac-be80-0b2ab32018d8 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.653111 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.653774 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.654063 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.654330 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.655027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.657094 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.678433 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1449/2860] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:18 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:18.682656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.693257 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46f06d-041d-45f0-ae14-573ad3f6e489 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.698023 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.698771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.699060 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.699336 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.700075 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.701845 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.713514 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1412/2861] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 15 04:32:18.717484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.728408 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825c6ec-1629-46b3-bfef-ac3d10787fa5 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.733123 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.733775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.734055 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.734328 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.735140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.736734 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163d4c7-d832-46f3-abc5-cbe20b006e55 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.746720 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1450/2862] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:18.751139 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.761134 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35908b71-e3ad-4ccd-b055-e05649b38c48 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.765817 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.767302 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] REQUEST_METHOD: `PUT` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.767585 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.767866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] PATH_INFO: `/v3/projects/d151428e70f24ac99f8799103edf54fc/users/49e57f179296489a9cd4c8d2b028a152/roles/07cb4a4189484db884216c920f46ba3d` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.782643 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d151428e70f24ac99f8799103edf54fc, user_id=49e57f179296489a9cd4c8d2b028a152, role_id=07cb4a4189484db884216c920f46ba3d)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.785316 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.798015 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1413/2863] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:18 2022] PUT /identity/v3/projects/d151428e70f24ac99f8799103edf54fc/users/49e57f179296489a9cd4c8d2b028a152/roles/07cb4a4189484db884216c920f46ba3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:18.803357 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439be90-7a8c-4d57-aa5a-dd6e68cf4492 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.803650 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439be90-7a8c-4d57-aa5a-dd6e68cf4492 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.803923 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439be90-7a8c-4d57-aa5a-dd6e68cf4492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.821855 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-4439be90-7a8c-4d57-aa5a-dd6e68cf4492 None None] MFA Rules not processed for user `15fad1a67004416983756cf42a1eae2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:18.823043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-4439be90-7a8c-4d57-aa5a-dd6e68cf4492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:18.880225 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1451/2864] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 15 04:32:18.889839 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:18.892199 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:18.947215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53259e6f-ff71-404f-a287-2ec38d272032 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:18.950870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:18.951510 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:18.951795 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:18.952071 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:18.961884 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:18.963334 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:18.972680 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1414/2865] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:22.985419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:22.985949 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:22.986135 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.013821 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.auth.core [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] MFA Rules not processed for user `49e57f179296489a9cd4c8d2b028a152`. Rule list: `[]` (Enabled: `True`). {{(pid=79226) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:23.015131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:23.079843 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1452/2866] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:23.084309 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.094249 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622e791-ca7a-48e7-a6dd-06762a7a25c8 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.099499 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.100191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.100477 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.100753 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.101503 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.103445 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.133135 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1415/2867] 10.222.0.45 () {60 vars in 1152 bytes} [Tue Feb 15 04:32:23 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 15 04:32:23.134395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.145873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33369ef-67cf-44be-b586-3de92463e7a0 None None] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.202631 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.203319 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] REQUEST_METHOD: `POST` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.204243 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.204547 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] PATH_INFO: `/v3/users` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.205293 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.207221 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.227618 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1453/2868] 10.222.0.45 () {60 vars in 1143 bytes} [Tue Feb 15 04:32:23 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 15 04:32:23.231907 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.242786 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe7296-2700-4b28-a3ef-484900220ef0 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.248537 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.249264 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.249549 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.249823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.250682 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.252362 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.263864 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1416/2869] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:23.269442 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.279363 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839cfc72-b39f-46ef-8f12-47650d36aabf admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.284190 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.285099 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.285384 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.285658 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] PATH_INFO: `/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2/users/10b1550b9c2e4b9e99e070db9a1bdc96/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.302057 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e65f9492c904b87b2cc1ca66ccdbea2, user_id=10b1550b9c2e4b9e99e070db9a1bdc96, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.304872 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.319131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1454/2870] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:23 2022] PUT /identity/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2/users/10b1550b9c2e4b9e99e070db9a1bdc96/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:32:23.323215 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.333828 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2049772-120b-4b1a-be0d-d1520fe68bce admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.391818 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.392773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.393084 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.393361 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.394103 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.395731 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a9b20-decc-4a25-9744-fab7e03762a0 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.406208 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1417/2871] 10.222.0.45 () {58 vars in 1121 bytes} [Tue Feb 15 04:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 15 04:32:23.410588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:23.430751 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd415a91-a2bc-4bc1-805c-785ed688cdba admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:23.443756 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:23.444657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:23.444985 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:23.445246 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] PATH_INFO: `/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2/users/10b1550b9c2e4b9e99e070db9a1bdc96/roles/3e51986d5b3b4564805a85330713b776` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:23.447177 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e65f9492c904b87b2cc1ca66ccdbea2, user_id=10b1550b9c2e4b9e99e070db9a1bdc96, role_id=3e51986d5b3b4564805a85330713b776)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:23.449854 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:23.467996 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1455/2872] 10.222.0.45 () {60 vars in 1482 bytes} [Tue Feb 15 04:32:23 2022] PUT /identity/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2/users/10b1550b9c2e4b9e99e070db9a1bdc96/roles/3e51986d5b3b4564805a85330713b776 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:32:27.945567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29544be8-1138-4cac-bc5b-fbff35337953 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:27.946407 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29544be8-1138-4cac-bc5b-fbff35337953 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:27.946833 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29544be8-1138-4cac-bc5b-fbff35337953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:28.003612 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-29544be8-1138-4cac-bc5b-fbff35337953 None None] MFA Rules not processed for user `10b1550b9c2e4b9e99e070db9a1bdc96`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:28.005059 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-29544be8-1138-4cac-bc5b-fbff35337953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:28.103540 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1418/2873] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:28.115987 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:28.117860 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:28.206022 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f8ff82-04e3-40f9-9de5-4697c0ab8ca4 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:28.211727 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:28.212387 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:28.212668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:28.212973 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:28.277140 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:28.279035 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:28.292805 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1456/2874] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:32:29.579961 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:29.580509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:29.580509 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:29.598686 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] MFA Rules not processed for user `49e57f179296489a9cd4c8d2b028a152`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:32:29.599879 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:29.606690 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1419/2875] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:32:51.526903 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:32:51.528331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:51.623339 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393a5c-8148-4e66-85f7-08dc7f48b2b8 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:32:51.629227 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:32:51.629876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:32:51.630159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:32:51.630436 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:32:51.632389 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:32:51.645369 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:32:51.646978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:32:51.657932 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1457/2876] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:32:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:33:07.408494 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:33:07.410718 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:33:07.465567 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d049e2f-e1c9-4e01-8ffc-14ac8b4ddc03 None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:33:07.469307 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:33:07.469953 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:33:07.470246 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:33:07.470529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:33:07.480118 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:33:07.481587 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e5a7f-cfd0-498a-acd6-797e04958dd1 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:33:07.491137 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1420/2877] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:33:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:34:14.260723 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:34:14.262148 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:34:14.337406 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de20620-f5bf-4799-b07f-d36fcb6bc930 service placement] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:34:14.341139 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '920aa75581fb41b0b6b09e07399a01b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:34:14.341775 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:34:14.342065 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:34:14.342338 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:34:14.344165 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:34:14.401352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:34:14.402797 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:34:14.411806 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1458/2878] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:34:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:34:25.316288 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] REQUEST_METHOD: `POST` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:34:25.316843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:34:25.316843 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:34:25.334333 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.auth.core [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] MFA Rules not processed for user `38c585ad31ef4f50bd695bb379107a9a`. Rule list: `[]` (Enabled: `True`). {{(pid=79225) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 15 04:34:25.335542 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:34:25.342313 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1421/2879] 10.222.0.45 () {58 vars in 957 bytes} [Tue Feb 15 04:34:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 15 04:34:38.839098 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:34:38.848503 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493a837-3e5a-40d5-924b-b8d9c2b60ee4 service cinder] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:34:38.852159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:34:38.852788 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:34:38.853093 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:34:38.853506 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:34:38.855289 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:34:38.889771 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:34:38.892141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:34:38.911876 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1459/2880] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:34:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:34:41.602622 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:34:41.612511 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a192ae-3f14-4181-8023-1bd848440c3e None None] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:34:41.616044 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:34:41.616679 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:34:41.616997 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:34:41.617279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:34:41.619033 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:34:41.680546 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:34:41.682034 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:34:41.692191 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1422/2881] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:35:23.337679 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:35:23.346894 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dee7d5-1909-46fe-be61-d4554c7c0587 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:35:23.350593 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:35:23.351222 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:35:23.351551 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:35:23.351835 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:35:23.353623 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:35:23.367105 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:35:23.368520 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:35:23.379112 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1460/2882] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:35:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:35:36.528233 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:35:36.537629 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa159f-b3f4-47bd-a074-165919b29a61 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:35:36.541427 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:35:36.542160 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:35:36.542518 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:35:36.542870 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:35:36.544764 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:35:36.555304 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:35:36.556837 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:35:36.565312 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1423/2883] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:35:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:35:36.643574 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:35:36.652296 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7058dc-1c77-42cc-b17f-35e24058f9a3 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:35:36.655943 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:35:36.656604 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:35:36.656887 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:35:36.657192 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:35:36.659612 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:35:36.672873 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:35:36.675159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:35:36.686141 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1461/2884] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:35:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:35:51.260016 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:35:51.268547 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f8ec-a51a-4c54-a032-db204c963f43 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:35:51.272560 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:35:51.273234 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:35:51.273520 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:35:51.273798 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:35:51.275697 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:35:51.286102 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:35:51.287577 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:35:51.295360 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1424/2885] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:35:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:36:33.554045 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:33.555460 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:33.570418 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599797d-e6fb-4877-8076-2426ce82c9f5 service neutron] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:33.576386 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:33.577098 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:33.577380 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:33.577651 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:33.579435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:33.592072 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:33.593696 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:33.604764 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1462/2886] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:36:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 15 04:36:45.907692 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:45.916295 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b756e445-bddc-4ee5-9019-dbbce9d3d9da service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:45.919933 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:45.920568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:45.920857 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:45.921175 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:45.922966 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:45.983969 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:45.985744 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:45.995535 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1425/2887] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:36:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:36:52.603199 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:52.605646 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:52.621636 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8493531-2526-419c-b245-d9f4a372f352 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:52.626705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:52.628175 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:52.628700 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:52.629095 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] PATH_INFO: `/v3/users/38c585ad31ef4f50bd695bb379107a9a` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:52.630323 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c585ad31ef4f50bd695bb379107a9a)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:52.633609 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:52.685608 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c585ad31ef4f50bd695bb379107a9a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:52.698073 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c585ad31ef4f50bd695bb379107a9a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:52.698818 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c585ad31ef4f50bd695bb379107a9a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:52.705588 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c585ad31ef4f50bd695bb379107a9a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:52.714159 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c585ad31ef4f50bd695bb379107a9a'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:52.720848 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1463/2888] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:36:52 2022] DELETE /identity/v3/users/38c585ad31ef4f50bd695bb379107a9a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:36:52.899498 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:52.923684 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa947f-6651-4cee-befe-979e38e859fa service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:52.984216 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:52.985648 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:52.985926 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:52.986201 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] PATH_INFO: `/v3/projects/35abc0d9f3874ffd9bfc3e12d88497c8` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:52.987430 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=35abc0d9f3874ffd9bfc3e12d88497c8)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:52.989359 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:53.036501 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35abc0d9f3874ffd9bfc3e12d88497c8', 'request_id': 'req-59779cb8-13b2-423f-9285-a6855b448baf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.042866 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35abc0d9f3874ffd9bfc3e12d88497c8', 'request_id': 'req-59779cb8-13b2-423f-9285-a6855b448baf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.050306 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35abc0d9f3874ffd9bfc3e12d88497c8', 'request_id': 'req-59779cb8-13b2-423f-9285-a6855b448baf'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.061171 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] The token cache is being invalidate because project 35abc0d9f3874ffd9bfc3e12d88497c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:36:53.061465 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.062098 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.063827 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1426/2889] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:36:52 2022] DELETE /identity/v3/projects/35abc0d9f3874ffd9bfc3e12d88497c8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:36:53.067705 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:53.069332 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:53.082298 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cb8bc-482f-4d24-b064-7bac416bae4e admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:53.137834 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:53.138698 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:53.138978 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:53.139258 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] PATH_INFO: `/v3/users/02ed78e195b04c1b9f3fae5eadf1fbf3` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:53.140449 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ed78e195b04c1b9f3fae5eadf1fbf3)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:53.142395 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:53.189654 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ed78e195b04c1b9f3fae5eadf1fbf3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.201415 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ed78e195b04c1b9f3fae5eadf1fbf3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.202110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ed78e195b04c1b9f3fae5eadf1fbf3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.208761 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ed78e195b04c1b9f3fae5eadf1fbf3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.217107 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ed78e195b04c1b9f3fae5eadf1fbf3'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.223081 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1464/2890] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:36:53 2022] DELETE /identity/v3/users/02ed78e195b04c1b9f3fae5eadf1fbf3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:36:53.392166 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:36:53.393714 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:36:53.407568 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779cb8-13b2-423f-9285-a6855b448baf admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:36:53.464486 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:36:53.465391 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:36:53.465935 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:36:53.466217 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] PATH_INFO: `/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:36:53.467963 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b633b33a6da341e0b9ad7579d4fa0f47)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:36:53.471773 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:36:53.519541 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b633b33a6da341e0b9ad7579d4fa0f47', 'request_id': 'req-839e734f-ff30-402c-a567-892577cb7efe'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.525115 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b633b33a6da341e0b9ad7579d4fa0f47', 'request_id': 'req-839e734f-ff30-402c-a567-892577cb7efe'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.531771 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b633b33a6da341e0b9ad7579d4fa0f47', 'request_id': 'req-839e734f-ff30-402c-a567-892577cb7efe'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.542954 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] The token cache is being invalidate because project b633b33a6da341e0b9ad7579d4fa0f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:36:53.543240 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.543867 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:36:53.545414 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1427/2891] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:36:53 2022] DELETE /identity/v3/projects/b633b33a6da341e0b9ad7579d4fa0f47 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:37:58.521431 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:37:58.522819 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:37:58.588981 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc9325-d33f-49b1-bedc-1333e88d0581 admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:37:58.643746 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:37:58.644378 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:37:58.644657 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:37:58.644947 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:37:58.646847 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:37:58.658989 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:37:58.660595 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:37:58.670331 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1465/2892] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:37:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:39:20.818396 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:20.820297 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:20.893779 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e734f-ff30-402c-a567-892577cb7efe admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:20.899936 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:20.900572 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:20.900859 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:20.901174 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:20.902928 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:20.956705 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:20.958315 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:20.967638 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1428/2893] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:39:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:39:22.943435 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:22.956451 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d531d-f091-4350-800a-4b13a0d9c717 service placement] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:22.963131 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f839e77bd3ad430d96b6957d398ec04a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:22.963770 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:22.964050 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:22.964321 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:22.966087 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:22.978799 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:22.980373 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:22.992204 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1466/2894] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:39:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:39:28.777130 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:28.778594 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:28.832418 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e7188-5d45-443b-87e3-622c38a68681 service nova] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:28.836872 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6dc0a5c1c714f0fb516cb1a6824ea83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:28.837531 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:28.837816 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:28.838097 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:28.839836 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:28.899397 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:28.900823 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:28.910077 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1429/2895] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 15 04:39:34.968009 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:34.970027 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:34.984220 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dae00f-d42b-4053-81b9-d5fd5d07d554 service nova] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:34.988845 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:34.989733 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:34.990013 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:34.990286 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] PATH_INFO: `/v3/users/49e57f179296489a9cd4c8d2b028a152` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:34.992075 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e57f179296489a9cd4c8d2b028a152)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:34.994016 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:35.042352 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e57f179296489a9cd4c8d2b028a152'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.054446 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e57f179296489a9cd4c8d2b028a152'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.055416 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e57f179296489a9cd4c8d2b028a152'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.062110 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e57f179296489a9cd4c8d2b028a152'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.070419 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e57f179296489a9cd4c8d2b028a152'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.077581 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1467/2896] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:39:34 2022] DELETE /identity/v3/users/49e57f179296489a9cd4c8d2b028a152 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:39:35.241971 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:35.251739 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bd6c6c-31e7-4e30-8b84-b35512c633a4 service neutron] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:35.308141 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:35.308984 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:35.309273 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:35.309551 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] PATH_INFO: `/v3/projects/d151428e70f24ac99f8799103edf54fc` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:35.310792 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d151428e70f24ac99f8799103edf54fc)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:35.312694 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:35.359182 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd151428e70f24ac99f8799103edf54fc', 'request_id': 'req-2a90c065-e259-4bdf-ab13-19e5d20cae36'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.364422 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd151428e70f24ac99f8799103edf54fc', 'request_id': 'req-2a90c065-e259-4bdf-ab13-19e5d20cae36'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.371666 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd151428e70f24ac99f8799103edf54fc', 'request_id': 'req-2a90c065-e259-4bdf-ab13-19e5d20cae36'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.382248 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] The token cache is being invalidate because project d151428e70f24ac99f8799103edf54fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:39:35.382536 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.383168 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.384677 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1430/2897] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:39:35 2022] DELETE /identity/v3/projects/d151428e70f24ac99f8799103edf54fc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:39:35.388634 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:35.390379 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:35.404668 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9bb744-5fb1-4a36-ae3b-d890605ee26b admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:35.462875 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:35.463760 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:35.464043 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:35.464308 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] PATH_INFO: `/v3/users/10b1550b9c2e4b9e99e070db9a1bdc96` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:35.465516 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b1550b9c2e4b9e99e070db9a1bdc96)` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:35.467405 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:35.512877 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b1550b9c2e4b9e99e070db9a1bdc96'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.525280 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b1550b9c2e4b9e99e070db9a1bdc96'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.525958 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b1550b9c2e4b9e99e070db9a1bdc96'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.532484 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b1550b9c2e4b9e99e070db9a1bdc96'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.539597 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.notifications [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b1550b9c2e4b9e99e070db9a1bdc96'} {{(pid=79226) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.545642 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1468/2898] 10.222.0.45 () {58 vars in 1223 bytes} [Tue Feb 15 04:39:35 2022] DELETE /identity/v3/users/10b1550b9c2e4b9e99e070db9a1bdc96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 15 04:39:35.715279 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Authenticating user token {{(pid=79225) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:39:35.717066 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.fernet_utils [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79225) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:39:35.730301 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90c065-e259-4bdf-ab13-19e5d20cae36 admin admin] Validating token access rules against request {{(pid=79225) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:39:35.786774 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15fad1a67004416983756cf42a1eae2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14db3a76771b4984aca50bf3056efc27', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79225) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:39:35.787656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:39:35.788562 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:39:35.788938 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] PATH_INFO: `/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2` {{(pid=79225) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:39:35.790101 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e65f9492c904b87b2cc1ca66ccdbea2)` {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:39:35.792051 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] RBAC: Authorization granted {{(pid=79225) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:39:35.837227 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e65f9492c904b87b2cc1ca66ccdbea2', 'request_id': 'req-8ab4fa55-f812-44d9-b9fb-61868ced8f80'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.842491 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e65f9492c904b87b2cc1ca66ccdbea2', 'request_id': 'req-8ab4fa55-f812-44d9-b9fb-61868ced8f80'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.849529 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e65f9492c904b87b2cc1ca66ccdbea2', 'request_id': 'req-8ab4fa55-f812-44d9-b9fb-61868ced8f80'} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.861188 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] The token cache is being invalidate because project 3e65f9492c904b87b2cc1ca66ccdbea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79225) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 15 04:39:35.861484 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.862123 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: DEBUG keystone.notifications [None req-8ab4fa55-f812-44d9-b9fb-61868ced8f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79225) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 15 04:39:35.863656 dv-cinder-816104-2-iscsi devstack@keystone.service[79225]: [pid: 79225|app: 0|req: 1431/2899] 10.222.0.45 () {58 vars in 1232 bytes} [Tue Feb 15 04:39:35 2022] DELETE /identity/v3/projects/3e65f9492c904b87b2cc1ca66ccdbea2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 15 04:43:05.501237 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Authenticating user token {{(pid=79226) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 15 04:43:05.502620 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:43:05.634084 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a8443-bb16-4aa3-b192-fd1cc8046ccd admin admin] Validating token access rules against request {{(pid=79226) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 15 04:43:05.690828 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8282bf8c7464ea5a8a84e84b3534ccc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e76b6b9b9e8247fbb69f16bb93c42b53', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79226) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 15 04:43:05.691465 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] REQUEST_METHOD: `GET` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 15 04:43:05.691745 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] SCRIPT_NAME: `/identity` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 15 04:43:05.692020 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79226) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 15 04:43:05.693773 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.fernet_utils [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79226) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 15 04:43:05.704975 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 15 04:43:05.706605 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b0671-30c9-4869-8df3-3d6ecece0904 service placement] RBAC: Authorization granted {{(pid=79226) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 15 04:43:05.717142 dv-cinder-816104-2-iscsi devstack@keystone.service[79226]: [pid: 79226|app: 0|req: 1469/2900] 10.222.0.45 () {60 vars in 1365 bytes} [Tue Feb 15 04:43:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)